-- Logs begin at Tue 2022-05-17 11:25:33 UTC, end at Tue 2022-05-17 12:33:40 UTC. -- May 17 11:57:27.487570 dv-cinder-837699-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 11:57:27.496329 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 11:57:27 2022] *** May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: nodename: dv-cinder-837699-7-iscsi May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: machine: x86_64 May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: clock source: unix May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: pcre jit disabled May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: detected number of CPU cores: 4 May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: current working directory: / May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: detected binary path: /usr/bin/uwsgi-core May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: your processes number limit is 47680 May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: your memory page size is 4096 bytes May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: detected max file descriptor number: 2048 May 17 11:57:27.498895 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: lock engine: pthread robust mutexes May 17 11:57:27.499954 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: thunder lock: enabled May 17 11:57:27.499954 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 11:57:27.499954 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 11:57:27.543653 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: Python main interpreter initialized at 0x5585edb849c0 May 17 11:57:27.543653 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: python threads support enabled May 17 11:57:27.543653 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: your server socket listen backlog is limited to 100 connections May 17 11:57:27.543653 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: your mercy for graceful operations on workers is 90 seconds May 17 11:57:27.543991 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: mapped 403077 bytes (393 KB) for 2 cores May 17 11:57:27.544094 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: *** Operational MODE: preforking *** May 17 11:57:27.544391 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: *** uWSGI is running in multiple interpreter mode *** May 17 11:57:27.544391 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: spawned uWSGI master process (pid: 102780) May 17 11:57:27.544580 dv-cinder-837699-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 11:57:27.546240 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: spawned uWSGI worker 1 (pid: 102781, cores: 1) May 17 11:57:27.546240 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: spawned uWSGI worker 2 (pid: 102782, cores: 1) May 17 11:57:27.546240 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 11:57:28.747840 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 11:57:28.755312 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 11:57:29.478095 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 11:57:29.478095 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: from cryptography.utils import int_from_bytes May 17 11:57:29.478410 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 11:57:29.478410 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: from cryptography.utils import int_from_bytes May 17 11:57:29.480511 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 11:57:29.480511 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: from cryptography.utils import int_from_bytes May 17 11:57:29.480839 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 11:57:29.480839 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: from cryptography.utils import int_from_bytes May 17 11:57:32.103646 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 11:57:32.104254 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 11:57:32.104447 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 11:57:32.104817 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 11:57:32.105079 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 11:57:32.105471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.105804 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.106664 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.106992 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.107330 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.107646 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.107978 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.108326 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.108663 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.108930 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.109253 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.109412 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 11:57:32.109779 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-7-iscsi {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.109872 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 11:57:32.109961 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.110194 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 11:57:32.110288 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.110507 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.110606 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 11:57:32.110811 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 11:57:32.110901 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.111129 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.111225 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.111456 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.111546 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.111767 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.111857 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.112161 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.112286 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.112524 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.112743 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.112862 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.113198 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.113328 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.113440 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.113553 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.113729 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.113829 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.114027 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.114120 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.114343 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.114434 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.114669 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.114753 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-7-iscsi {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.114985 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.115115 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.115307 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.115397 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.115618 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.115715 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.115943 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.116027 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-7-iscsi {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.116278 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.116383 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.116613 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.116747 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.116928 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.117022 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.117376 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.117472 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.117699 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.117791 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.118014 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.118098 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.118344 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.118440 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.118693 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.118831 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.118987 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.119083 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.119301 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.119393 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.119629 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.119725 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.119945 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.120123 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.120293 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.120387 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.120603 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.120695 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.120916 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.121011 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-7-iscsi {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.121231 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.121330 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.121619 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.122208 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.122557 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.122651 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.122895 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.123044 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.123133 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.123370 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.123462 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.123690 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.123781 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.124021 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.124123 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.124382 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.124489 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.124640 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.124730 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.124898 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.125023 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.125225 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.125357 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.125551 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.125685 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.125865 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.126011 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.126181 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.126323 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.126495 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.126641 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.126809 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.126958 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.127120 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.127284 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.127433 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.127597 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.127752 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.127910 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.128064 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.128169 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.128416 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.128509 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.128741 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.128845 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.129069 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.129155 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.129382 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.129516 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.129701 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.129785 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.129960 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.130098 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.130290 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.130376 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.130617 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.130702 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.130933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.131026 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.131252 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.131338 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.131568 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.131654 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.131882 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.131978 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.132211 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.132301 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.132526 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.132620 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.132837 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.132930 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.133145 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.133236 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.133470 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.133562 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.133792 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.133892 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.134101 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.134192 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.134357 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.134451 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.134664 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.134751 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.134976 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.135130 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.135301 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.135393 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.135614 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.135707 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.135925 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.136031 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.136261 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.136386 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.136571 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.136697 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.136882 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.137024 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.137858 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.137977 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.138060 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.138137 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.138225 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.138309 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.138386 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.138468 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.138599 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.138717 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.138868 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.139023 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.139110 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.139333 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.139425 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.139598 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.139682 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.139910 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.140003 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.140247 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.140336 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.140579 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.140666 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.140885 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.140981 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.141195 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.141281 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.141508 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.141598 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.141817 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.141900 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.142128 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.142214 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.142440 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.142524 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.142750 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.142833 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.143059 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.143145 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.143371 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.143460 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.143680 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.143775 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.143991 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.144075 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.144327 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.144414 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.144636 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.144729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.144948 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.145038 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.145270 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.145355 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.145581 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.145678 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.145891 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.145975 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.146197 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.146280 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.146505 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.146600 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.146813 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.146900 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.147123 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.147217 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.147431 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.147588 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.147746 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.147830 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.148051 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.148145 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.148386 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.148484 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.148711 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.148803 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.149025 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.149108 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.149334 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.149419 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.149644 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.149729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.149952 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.150041 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.150266 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.150352 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.150590 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.150685 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.150904 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.150997 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.151218 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.151310 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.151530 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.151615 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.151841 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.151943 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.152151 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.152303 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.152486 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.152571 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.152834 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.152942 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.153151 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.153377 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.153507 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.153697 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.153782 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.154017 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.154110 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.154336 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.154421 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.154660 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.154748 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.154986 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.155071 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.155319 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 11:57:32.155404 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.155640 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.155731 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.155963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.156055 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.156321 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.156433 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.156641 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.156749 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.156962 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.157048 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.157298 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.157389 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.157631 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.157740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.157948 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.158045 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.158271 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.158357 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.158608 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.158702 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.158931 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.159035 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.159250 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.159337 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.159571 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.159670 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.159885 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.159969 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.160216 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.160305 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.160539 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.160634 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.160867 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.160958 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.161193 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.161276 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.161516 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.161607 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.161832 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.161916 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.162158 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.162242 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.162481 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.162568 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.162800 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.162886 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.163120 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.163215 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.163436 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.163522 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.163782 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.163867 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.164106 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.164212 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.164470 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.164561 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.164802 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.164890 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.165126 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.165218 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.165451 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.165537 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.165766 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.165858 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.166086 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.166179 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.166398 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.166482 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.166710 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.166797 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.167021 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.167114 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.167336 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.167422 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.167653 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.167739 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.167970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.168062 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.168320 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.168920 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.169159 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.169364 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.169499 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.169669 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.169806 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.170004 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.170133 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.170334 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.170471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.170659 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.170800 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.170989 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.171119 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.171307 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.171515 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.171649 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.171795 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.171928 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.172069 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.172259 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.172407 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.172575 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.172704 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.172887 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.172971 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.173210 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.173317 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.173518 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.173602 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.173827 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.173913 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.174146 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.174233 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.174462 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.174548 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.174777 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.174862 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.175095 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.175182 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.175411 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.175496 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.175729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.175813 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.176044 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.176130 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.176382 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.176479 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.176706 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.176798 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.177027 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.177112 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.177337 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.177420 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.177664 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.177757 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.177981 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.178064 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.178298 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.178383 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.178604 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.178699 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.178919 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.179003 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.179301 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.179442 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.179540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.179628 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.179830 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.179917 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.180143 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.180248 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.180476 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.180579 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.180782 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.180867 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.181088 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.181173 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.181395 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.181482 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.181703 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.181796 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.182028 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.182130 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.182341 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.182428 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.182649 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.182736 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.182956 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.183041 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.183264 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.183358 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.183609 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.183695 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.183920 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.184004 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.184921 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.185011 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.185265 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.185364 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.185591 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.185689 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.185918 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.186010 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.186237 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.186330 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.186551 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.186647 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.186864 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.186948 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.187176 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.187259 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.187491 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.187585 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.187801 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.188159 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.188417 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.188501 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.188735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.188832 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.189051 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.189144 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.189410 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.189506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.189672 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.189775 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.189990 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.190073 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.190314 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.190398 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.190625 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.190711 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.190947 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.191032 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.191292 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.191376 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.191620 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.191704 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.191941 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.192027 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.192291 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.192389 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.192608 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.192693 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.192928 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.193019 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.193241 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.193331 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.193560 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.193645 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.193873 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.193970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.194191 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.194285 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.194517 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.194607 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.194831 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.194926 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.195157 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.195261 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.195470 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.195556 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.195793 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.195878 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.196105 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.196222 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.196452 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.196537 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.196759 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.196842 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.197076 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.197170 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.197408 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.197501 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.197751 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.197834 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.198063 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.198147 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.198379 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.198465 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.198697 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.198781 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.199010 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.199095 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.199325 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.199417 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.199658 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.199765 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.199973 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.200069 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.200304 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.200437 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.200623 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.200775 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.200943 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.201098 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.201257 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.201433 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.201572 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.201755 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.201917 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.202086 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.202171 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.202403 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.202495 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.202729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.202822 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.203066 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.203158 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.203378 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.203463 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.203704 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.203791 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.204020 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.204106 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.204372 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.204506 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.204693 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.204787 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.205001 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.205098 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.205309 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.205410 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.205620 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.205711 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.205935 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.206032 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.206245 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.206337 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.206555 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.206648 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.206864 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.206949 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.207179 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.207271 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.207494 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.207579 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.207812 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.207896 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.208125 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.208250 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.208463 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.208550 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.208777 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.208862 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.209096 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.209188 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.209412 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.209504 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.209727 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.209823 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.210053 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.210140 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.210375 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.210461 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.210688 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.210778 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.211001 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.211088 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.211314 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.211405 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.211630 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.211716 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.211942 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.212027 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.212284 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.212374 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.212599 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.212684 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.212917 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.213004 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.213234 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.213319 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.213545 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.213638 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.213860 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.213946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.214183 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.214268 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.214497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.214757 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.214843 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.215099 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.215191 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.215472 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.215593 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.215804 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.215982 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.216134 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.216339 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.216478 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.216667 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.216799 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.217004 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.217120 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.217340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.217426 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.217700 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.217795 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.218018 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.218111 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.218336 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.218422 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.218650 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.218735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.218961 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.219048 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.219270 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.219353 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.219579 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.219671 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.219893 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.219986 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.220220 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.220496 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.220589 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.220836 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.220927 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.221146 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.221238 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.221455 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.221540 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.221765 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.221851 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.222084 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.222174 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.222393 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.222488 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.222709 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.222802 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.223018 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.223109 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.223345 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.223441 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.223660 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.223763 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.223970 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.224062 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.224301 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.224389 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.224614 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.224702 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.224934 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.225017 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.225247 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.225337 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.225561 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.225655 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.225876 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.225968 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.226191 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.226284 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.226504 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.226592 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.226816 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.226909 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.227129 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.227214 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.227438 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.227522 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.227749 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.227839 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.228055 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.228152 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.228391 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.228477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.228702 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.228785 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.229012 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.229108 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.229319 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.229403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.229630 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.229714 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.229938 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.230033 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.230248 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.230333 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.230556 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.230641 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.230870 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.231577 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.231826 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.231982 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.232297 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.232518 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.232685 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.232869 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.233001 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.233192 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.233313 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.233530 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.233630 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.233852 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.233953 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.234170 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.234257 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.234486 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.234581 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.234805 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.234891 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.235123 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.235209 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.235433 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.235525 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.235745 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.235830 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.236055 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.236140 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.236398 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.236500 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.236712 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.236802 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.237022 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.237108 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.237337 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.237428 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.237650 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.237741 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.237965 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.238055 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.238274 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.238360 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.238584 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.238668 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.238890 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.238974 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.239201 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.239287 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.239514 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.239599 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.239826 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.239960 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.240144 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.240253 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.240475 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.240560 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.240791 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.240886 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.241103 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.241187 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.241412 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.241495 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.241718 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.241809 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.242031 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.242118 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.242339 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.242423 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.242646 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.242738 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.242954 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.243039 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.243262 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.243365 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.243567 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.243660 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.243876 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.243977 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.244205 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.244294 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.244524 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.244610 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.244835 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.244919 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.245140 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.245223 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.245468 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.245553 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.245781 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.245874 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.246097 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.246181 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.246415 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.246502 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.247294 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.247407 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.247681 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.247785 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.247982 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.248087 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.248329 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.248432 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.248645 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.248743 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.248957 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.249050 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.249269 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.249353 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.249580 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.249676 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.249892 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.249991 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.250224 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.250328 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.250532 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.250625 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.250842 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.250928 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.251156 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.251247 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.251468 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.251554 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.251790 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.251873 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.252117 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.252221 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.252472 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.252558 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.252787 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.252880 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.253105 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.253197 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.253425 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.253511 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.253742 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.253850 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.254060 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.254157 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.254373 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.254459 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.254682 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.254773 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.254994 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.255091 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.255311 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.255395 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.255675 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.255771 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.255937 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.256032 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.256275 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.256367 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.256584 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.256677 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.256896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.257066 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.257206 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.257292 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.257535 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.257619 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.257848 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.257941 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.258164 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.258258 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.258478 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.258561 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.258785 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.258870 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.259101 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.259186 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.259409 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.259493 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.259725 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.259842 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.260045 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.260162 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.260462 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.260562 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.260794 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.260881 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.261115 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.261206 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.261432 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.261517 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.261750 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.261834 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.262065 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.262149 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.262372 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.262462 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.262780 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.262889 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.263029 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.263291 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.263391 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.263614 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.263714 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.263935 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.264016 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.264275 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.264375 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.264590 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.264681 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.264908 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.265002 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.265240 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.265327 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.265553 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.265694 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.265864 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.266024 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.266174 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.266348 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.266502 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.266663 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.266813 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.266983 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.267141 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.267303 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.267563 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.267648 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.267880 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.267966 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.268209 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.268314 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.268638 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.268724 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.268960 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.269054 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.269277 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.269379 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.269598 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.269694 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.269916 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.270000 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.270230 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.270316 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.270540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.270641 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.270862 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.270946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.271174 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.271259 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.271488 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.271574 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.271801 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.271897 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.272120 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.272237 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.272463 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.272547 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.272771 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.272861 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.273100 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.273187 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.273428 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.273528 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.273748 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.273835 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.274076 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.274235 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.274495 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.274591 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.274825 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.274910 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.275141 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.275234 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.275468 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.275562 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.275800 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.275925 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.276110 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.276256 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.276446 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.276531 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.276768 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.276852 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.277078 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.277174 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.277391 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.277483 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.277720 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.277813 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.278100 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.278193 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.278426 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.278512 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.278743 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.278829 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.279058 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.279144 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.279367 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.279459 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.279678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.279762 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.280006 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.280134 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.280359 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.280491 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.280690 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.280812 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.281010 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.281144 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.281337 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.281476 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.281662 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.281793 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.281972 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.282113 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.282300 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.282421 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.282615 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.282718 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.282929 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.283034 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.283241 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.283366 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.283551 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.283694 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.283898 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.284016 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.284232 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.284372 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.284565 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.284682 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.284901 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.284998 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.285236 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.285332 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.285553 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.285656 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.285892 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.286011 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.286225 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.286320 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.286542 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.286628 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.286864 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.286948 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.287191 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.287274 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.287500 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.287593 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.287811 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.287906 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.288127 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.288228 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.288464 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.288551 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.288781 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.288867 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.289091 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.289175 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.289407 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.289494 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.289717 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.289809 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.290027 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.290122 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.290336 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.290422 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.290664 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.290762 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.290973 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.291068 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.291300 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.291386 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.291617 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.291710 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.291928 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.292022 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.292263 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.292370 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.292577 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.292670 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.292924 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.293019 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.293236 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.293323 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295016 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295121 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295202 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295279 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295346 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295418 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295484 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295548 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295625 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295693 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295757 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.295821 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.296022 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.296150 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.296309 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.296397 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.296630 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.296723 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.296948 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.297033 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.297266 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.297353 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.297585 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.297676 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.297902 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.298031 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.298215 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.298299 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.298525 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.298609 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.298850 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.298943 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.299174 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.299260 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.299513 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.299708 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.299841 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.300046 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.300173 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.300410 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.300531 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.300735 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.300832 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.301053 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.301169 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.301373 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.301496 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.301690 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.301821 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.302011 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.302147 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.302329 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.302471 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.302645 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.302795 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.302962 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.303118 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.303297 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.303442 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.303626 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.303761 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.303957 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.304085 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.304324 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.304436 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.304653 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.304794 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.304971 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.305284 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.305379 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.305602 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.305767 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.305934 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.306019 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.306264 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.306359 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.306574 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.306668 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.306895 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.306988 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.307215 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.307300 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.307532 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.307619 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.307850 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.307935 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.308162 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.308266 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.308505 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.308592 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.308829 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.308919 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.309698 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.309791 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.310034 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.310128 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.310355 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.310448 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.310675 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.310785 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.311001 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.311097 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.311325 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.311411 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.311647 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.311745 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.311967 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.312060 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.312311 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.312402 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.312635 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.312730 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.313235 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.313446 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.313559 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.313768 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.313930 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.314110 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.314196 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.314441 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.314534 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.314771 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.314866 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.315094 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.315179 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.315415 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.315500 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.315736 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.315830 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.316047 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.316131 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.316383 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.316470 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.316704 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.316792 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.317019 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.317118 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.317328 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.317413 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.317654 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.317741 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.317967 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.318062 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.318276 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.318362 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.318600 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.318801 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.318921 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.319127 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.319457 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.319555 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.319789 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.319874 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.320117 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.320236 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.320469 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.320567 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.320797 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.320883 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.321121 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.321218 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.321433 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.321529 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.321743 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.321834 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.322059 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.322143 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.322370 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.322465 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.322689 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.322775 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.323006 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.323092 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.323316 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.323404 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.323626 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.323712 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.323940 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.324032 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.324279 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.324367 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.324590 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.324922 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.325100 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.325410 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.325509 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.325838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.325923 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.326153 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.326342 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.326468 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.326761 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.326848 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.327079 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.327255 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.327390 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.327698 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.327784 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.328010 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.328095 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.328346 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.328435 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.328665 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.328752 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.328977 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.329070 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.329293 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.329381 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.329603 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.329689 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.329919 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.330006 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.330230 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.330316 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.330547 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.330634 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.330870 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.330954 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.331194 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.331300 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.331510 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.331596 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.331817 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.331908 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.332140 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.332251 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.332503 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.332593 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.332807 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.332892 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.333125 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.333219 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.333442 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.333535 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.333777 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.333862 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.334092 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.334186 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.334408 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.334634 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.334727 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.334973 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.335067 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.335300 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.335392 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.335629 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.335714 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.335958 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.336051 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.336293 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.336401 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.336609 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.336704 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.336922 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.337017 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.337251 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.337337 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.337568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.337661 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.337883 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.337978 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.338200 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.338293 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.338513 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.338606 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.338835 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.338922 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.339150 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.339236 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.339465 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.339551 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.339779 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.339873 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.340092 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.340197 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.340504 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.340823 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.340919 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.341138 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.341224 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.341458 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.341550 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.341805 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.341899 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.342127 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.342268 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.342449 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.342542 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.342766 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.342854 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.343084 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.343169 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.343395 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.343480 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.343708 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.343795 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.344020 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.344107 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.344359 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.344446 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.344678 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.344773 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.345008 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.345096 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.345325 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.345417 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.345633 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.345718 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.345958 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.346044 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.346278 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.346377 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.346598 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.346684 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.346918 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.347003 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.347236 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.347330 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.347558 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.347643 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.347911 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.348004 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.348252 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.348342 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.348578 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.348662 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.348896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.348991 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.349222 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.349315 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.349541 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.349627 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.349860 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.349947 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.350179 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.350267 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.350487 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.350585 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.350797 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.350890 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.351107 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.351193 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.351421 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.351548 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.351740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.351835 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.352051 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.352171 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.352387 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.352523 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.352698 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.352854 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.353011 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.353184 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.353320 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.353504 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.353632 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.353878 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.353972 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.354164 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.354252 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.354485 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.354581 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.354816 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.354903 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.355122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.355214 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.355431 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.355530 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.355740 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.355833 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.356583 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.356815 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.356901 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.357194 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.357281 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.357503 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.357591 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.357813 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.357908 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.358120 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.358213 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.358430 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.358515 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.358737 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.358832 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.359067 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.359152 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.359385 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.359478 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.359701 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.359796 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.360022 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.360109 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.360363 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.360463 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.360683 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.360783 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.360995 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.361080 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.361308 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.361442 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.361631 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.361717 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.361940 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.362026 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.362251 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.362343 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.362563 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.362648 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.362876 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.362964 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.363191 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.363277 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.363503 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.363598 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.363816 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.363902 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.364127 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.364230 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.364467 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.364560 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.364777 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.364862 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.365094 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.365193 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.365407 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.365502 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.365731 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.365860 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.366052 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.366148 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.366378 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.366471 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.366698 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.366784 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.367016 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.367118 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.367342 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.367426 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.367656 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.367740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.367971 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.368059 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.368315 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.368405 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.368630 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.368715 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.368945 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.369031 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.369269 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.369353 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.369588 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.369673 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.369906 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.369991 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.370230 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.370316 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.370541 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.370625 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.370859 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.370944 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.371179 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.371265 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.371532 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.372234 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.372417 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.372502 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.372786 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.372943 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.373120 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.373280 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.373447 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.373600 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.373778 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.373919 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.374103 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.374231 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.374424 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.374510 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102782) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 11:57:32.374761 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.375083 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.375403 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.375728 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.376045 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.376393 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.376720 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.377042 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.377378 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.377713 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.378030 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.378362 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.378695 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.379048 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.379370 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.379733 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.380070 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.380418 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.380742 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.381057 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 11:57:32.381309 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 11:57:32.397818 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG oslo_db.sqlalchemy.engines [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 11:57:32.403994 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_db.sqlalchemy.engines [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 11:57:32.461417 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.context [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09ab1f8a-4b58-4541-9d13-ce3277a151d2(cell1) {{(pid=102782) load_cells /opt/stack/nova/nova/context.py:464}} May 17 11:57:32.466364 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG oslo_concurrency.lockutils [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 11:57:32.467915 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG oslo_concurrency.lockutils [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 11:57:32.468453 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.context [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09ab1f8a-4b58-4541-9d13-ce3277a151d2(cell1) {{(pid=102781) load_cells /opt/stack/nova/nova/context.py:464}} May 17 11:57:32.468740 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG oslo_concurrency.lockutils [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 11:57:32.470672 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG oslo_concurrency.lockutils [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102782) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 11:57:32.472772 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 11:57:32.474357 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 11:57:32.475156 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 11:57:32.477146 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 11:57:32.482119 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG oslo_db.sqlalchemy.engines [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 11:57:32.485656 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG oslo_db.sqlalchemy.engines [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 11:57:32.490963 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_db.sqlalchemy.engines [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 11:57:32.494620 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_db.sqlalchemy.engines [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 11:57:32.646754 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG oslo_db.sqlalchemy.engines [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102782) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 11:57:32.654551 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_db.sqlalchemy.engines [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 11:57:32.987288 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: WARNING keystonemiddleware.auth_token [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 11:57:32.988218 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: WARNING keystonemiddleware.auth_token [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 11:57:32.994647 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: WARNING keystonemiddleware.auth_token [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 11:57:32.996516 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: WARNING keystonemiddleware.auth_token [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 11:57:33.339628 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: WARNING keystonemiddleware.auth_token [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 11:57:33.340763 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: WARNING keystonemiddleware.auth_token [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 11:57:33.346227 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: WARNING keystonemiddleware.auth_token [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 11:57:33.346439 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: WARNING keystonemiddleware.auth_token [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 11:57:33.352300 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585edb849c0 pid: 102782 (default app) May 17 11:57:33.352484 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585edb849c0 pid: 102781 (default app) May 17 11:57:33.354407 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:57:33.355596 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-0826f05f-51ff-4ce5-b1da-f0a7affbc2d1 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 May 17 11:57:33.356779 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Tue May 17 11:57:33 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:58:50.992968 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:58:50.994843 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002742 May 17 11:58:50.995404 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:58:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:58:51.411387 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-401b3129-b341-4070-88d2-f9ff79e03f06 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:58:51.441798 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-401b3129-b341-4070-88d2-f9ff79e03f06 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.439887 May 17 11:58:51.442461 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1291 bytes} [Tue May 17 11:58:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 11:58:53.727692 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:58:53.728707 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-a345b148-8d33-4465-87fe-12a11c7fc174 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 May 17 11:58:53.729288 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 2/4] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:58:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:58:53.794469 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-ebcb992a-5570-444e-8bb3-2288d18f1085 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 1}} {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:58:53.813382 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 11:58:53.813382 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: warnings.warn(msg) May 17 11:58:53.843402 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-ebcb992a-5570-444e-8bb3-2288d18f1085 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107488 May 17 11:58:53.843982 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 3/5] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 17 11:58:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 11:58:54.061758 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-2fc3b3be-248c-4b45-87b4-24750143aa44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:58:54.064329 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 11:58:54.064329 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: warnings.warn(msg) May 17 11:58:54.114606 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-2fc3b3be-248c-4b45-87b4-24750143aa44 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262448 May 17 11:58:54.115516 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 3/6] 10.222.0.58 () {64 vars in 1335 bytes} [Tue May 17 11:58:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 11:58:56.396608 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-ebcb992a-5570-444e-8bb3-2288d18f1085 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:58:56.397640 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-ebcb992a-5570-444e-8bb3-2288d18f1085 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 17 11:58:56.398070 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 4/7] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:58:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:58:56.518719 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-9820fa7d-915e-4970-a057-253081c323d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:58:56.537102 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 11:58:56.537102 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: warnings.warn(msg) May 17 11:58:56.556780 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-9820fa7d-915e-4970-a057-253081c323d2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152674 May 17 11:58:56.557545 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 4/8] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 17 11:58:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 11:58:56.569408 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-0efd0acb-5feb-4daa-83d2-b4582f8d1948 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:58:56.570897 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 11:58:56.570897 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: warnings.warn(msg) May 17 11:58:56.603141 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-0efd0acb-5feb-4daa-83d2-b4582f8d1948 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037272 May 17 11:58:56.603679 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 5/9] 10.222.0.58 () {64 vars in 1335 bytes} [Tue May 17 11:58:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 11:58:58.919665 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-9820fa7d-915e-4970-a057-253081c323d2 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:58:58.921313 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-9820fa7d-915e-4970-a057-253081c323d2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 May 17 11:58:58.921726 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:58:58.982517 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-0243730a-ba4d-4196-9ec3-df00744459da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "swap": 0}} {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:58:59.004853 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-0243730a-ba4d-4196-9ec3-df00744459da admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077130 May 17 11:58:59.005873 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 6/11] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 17 11:58:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 11:58:59.018885 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-15d24ecf-e76c-4451-8f2a-ca5e6c919727 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:58:59.042779 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-15d24ecf-e76c-4451-8f2a-ca5e6c919727 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027760 May 17 11:58:59.043873 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 6/12] 10.222.0.58 () {64 vars in 1335 bytes} [Tue May 17 11:58:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 11:59:01.365947 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-0243730a-ba4d-4196-9ec3-df00744459da admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:01.367000 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-0243730a-ba4d-4196-9ec3-df00744459da admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 17 11:59:01.367415 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 7/13] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:01.432871 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-0a1fea9d-c9f2-4809-9d84-99b026a721e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "id": "d3", "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:01.453538 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-0a1fea9d-c9f2-4809-9d84-99b026a721e2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079268 May 17 11:59:01.454480 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 7/14] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 17 11:59:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 11:59:01.466507 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-0e5f61a1-3f05-4b05-9f71-dd49dca37330 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:01.494186 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-0e5f61a1-3f05-4b05-9f71-dd49dca37330 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031553 May 17 11:59:01.495021 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 8/15] 10.222.0.58 () {64 vars in 1335 bytes} [Tue May 17 11:59:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 11:59:03.788066 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-0a1fea9d-c9f2-4809-9d84-99b026a721e2 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:03.789105 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-0a1fea9d-c9f2-4809-9d84-99b026a721e2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 May 17 11:59:03.789490 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 8/16] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:03.851973 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-f30d8ad7-bcf7-44bc-b8d3-ef41f0e04334 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:03.872960 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-f30d8ad7-bcf7-44bc-b8d3-ef41f0e04334 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076016 May 17 11:59:03.880228 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 9/17] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 17 11:59:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 11:59:03.885938 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-455ed558-623d-4f2f-a684-dbc614da5daa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:03.910324 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-455ed558-623d-4f2f-a684-dbc614da5daa admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028131 May 17 11:59:03.911108 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 9/18] 10.222.0.58 () {64 vars in 1335 bytes} [Tue May 17 11:59:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 11:59:06.197078 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-f30d8ad7-bcf7-44bc-b8d3-ef41f0e04334 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:06.198098 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-f30d8ad7-bcf7-44bc-b8d3-ef41f0e04334 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 17 11:59:06.198511 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 10/19] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:06.263173 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-486f05f9-b47a-4f92-a053-01ca11855dbe admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:06.286698 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-486f05f9-b47a-4f92-a053-01ca11855dbe admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081386 May 17 11:59:06.287356 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1291 bytes} [Tue May 17 11:59:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 11:59:08.830076 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-f30d8ad7-bcf7-44bc-b8d3-ef41f0e04334 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:08.831418 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-f30d8ad7-bcf7-44bc-b8d3-ef41f0e04334 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001932 May 17 11:59:08.831904 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 11/21] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:08.901286 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-71cb49c7-5851-4c06-83fb-27d8d823d0eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:08.920296 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-71cb49c7-5851-4c06-83fb-27d8d823d0eb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082656 May 17 11:59:08.920906 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 11/22] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 17 11:59:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 11:59:08.934196 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-c276b4ec-ad65-4590-95d6-1d25690e84fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:08.960940 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-c276b4ec-ad65-4590-95d6-1d25690e84fa admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031492 May 17 11:59:08.961686 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 12/23] 10.222.0.58 () {64 vars in 1332 bytes} [Tue May 17 11:59:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 11:59:11.258577 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-71cb49c7-5851-4c06-83fb-27d8d823d0eb admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:11.260105 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-71cb49c7-5851-4c06-83fb-27d8d823d0eb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 May 17 11:59:11.260700 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 12/24] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:11.321742 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-6be61548-142f-4b54-8c00-6ded86125681 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "id": "2", "vcpus": 1, "swap": 0, "name": "m1.small"}} {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:11.343288 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-6be61548-142f-4b54-8c00-6ded86125681 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076445 May 17 11:59:11.344039 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 13/25] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 17 11:59:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 11:59:11.355759 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-382a27b9-7050-4cfa-b9ec-76b159b975b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:11.378989 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-382a27b9-7050-4cfa-b9ec-76b159b975b1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026866 May 17 11:59:11.379843 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 13/26] 10.222.0.58 () {64 vars in 1332 bytes} [Tue May 17 11:59:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 11:59:13.807098 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-6be61548-142f-4b54-8c00-6ded86125681 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:13.808030 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-6be61548-142f-4b54-8c00-6ded86125681 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 17 11:59:13.808483 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 14/27] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:13.866579 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-f72bc34f-173a-4b43-97aa-8be8e645ab2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:13.883722 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-f72bc34f-173a-4b43-97aa-8be8e645ab2d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069468 May 17 11:59:13.884312 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 14/28] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 17 11:59:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 11:59:13.896992 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-5872481a-1700-4249-ad43-26d88aa0bb5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:13.920077 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-5872481a-1700-4249-ad43-26d88aa0bb5b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026704 May 17 11:59:13.920702 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 15/29] 10.222.0.58 () {64 vars in 1332 bytes} [Tue May 17 11:59:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 11:59:16.194821 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-f72bc34f-173a-4b43-97aa-8be8e645ab2d admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:16.195866 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-f72bc34f-173a-4b43-97aa-8be8e645ab2d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 17 11:59:16.196334 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 15/30] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:16.251586 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-f30f9eb0-b29b-4058-aada-66ad465c1480 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80}} {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:16.270488 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-f30f9eb0-b29b-4058-aada-66ad465c1480 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068234 May 17 11:59:16.271166 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 16/31] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 17 11:59:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 11:59:16.287096 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-1be0a636-ea5c-42e3-a1f4-c78013fc9ad0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:16.312286 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-1be0a636-ea5c-42e3-a1f4-c78013fc9ad0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032331 May 17 11:59:16.312867 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 16/32] 10.222.0.58 () {64 vars in 1332 bytes} [Tue May 17 11:59:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 11:59:18.604659 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-f30f9eb0-b29b-4058-aada-66ad465c1480 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:18.605679 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-f30f9eb0-b29b-4058-aada-66ad465c1480 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 17 11:59:18.606083 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 17/33] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:18.667056 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-f475d056-8c22-46bd-a280-455e635407c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "vcpus": 8, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:18.685274 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-f475d056-8c22-46bd-a280-455e635407c8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073045 May 17 11:59:18.686569 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 17/34] 10.222.0.58 () {64 vars in 1282 bytes} [Tue May 17 11:59:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 11:59:18.698463 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-4869772a-e76c-4593-8baa-456f2b093cfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:18.723883 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-4869772a-e76c-4593-8baa-456f2b093cfb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028992 May 17 11:59:18.725259 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 18/35] 10.222.0.58 () {64 vars in 1332 bytes} [Tue May 17 11:59:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 11:59:43.043292 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-f475d056-8c22-46bd-a280-455e635407c8 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:43.045012 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-f475d056-8c22-46bd-a280-455e635407c8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 May 17 11:59:43.045422 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 18/36] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 11:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:43.102015 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-0f826e1e-9835-4721-8e3c-526f81c5ccc2 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:43.119064 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-0f826e1e-9835-4721-8e3c-526f81c5ccc2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067753 May 17 11:59:43.119591 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 19/37] 10.222.0.58 () {60 vars in 1291 bytes} [Tue May 17 11:59:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 11:59:44.120633 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-f475d056-8c22-46bd-a280-455e635407c8 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:44.121683 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-f475d056-8c22-46bd-a280-455e635407c8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 17 11:59:44.122149 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 19/38] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 11:59:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:44.322151 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-e319d2ef-2ede-4c60-a10d-3a95582e3b02 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:44.328394 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.wsgi [None req-e319d2ef-2ede-4c60-a10d-3a95582e3b02 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-e319d2ef-2ede-4c60-a10d-3a95582e3b02 admin admin] Request method failure captured: May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Accept: application/json May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Accept-Encoding: gzip, deflate May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Connection: keep-alive May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Content-Length: 0 May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Host: 10.222.0.58 May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Openstack-Api-Version: compute 2.90 May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Openstack-System-Scope: None May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: User-Agent: python-novaclient May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Auth-Token: gAAAAABig44wDb1f8x6eZXbonXXOM_ziQsB19Jy2kN5mTVvu91Q9ESTZ0Qkjc3YeOHATEWyavdeVEwfcYG9lAhYTw6dUCuwBUeFGoTnahRIV0RLELk58QzmiVPaCPhZba2J03VmEGrRPejzD2i2xRYKwMI8fuh4WNYUeVxMRFmMdbtF9xazezOo May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Domain-Id: None May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Domain-Name: None May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Identity-Status: Confirmed May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Is-Admin-Project: True May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Openstack-Nova-Api-Version: 2.90 May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Domain-Id: default May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Domain-Name: Default May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Name: admin May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Role: member,reader,admin May 17 11:59:44.331678 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Roles: member,reader,admin May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2acfce5cbf9f4de7bfe02428af601440", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}] May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Tenant: admin May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Tenant-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Tenant-Name: admin May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User: admin May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Domain-Id: default May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Domain-Name: Default May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Id: f0ae019bc4584bc39f9f7fb0d0af90e6 May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Name: admin May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: method: > May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: exception: Flavor 42 could not be found. May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: action_args: {'id': '42'} May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 11:59:44.333340 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:44.334403 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:44.335838 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-e319d2ef-2ede-4c60-a10d-3a95582e3b02 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 11:59:44.337254 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-e319d2ef-2ede-4c60-a10d-3a95582e3b02 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063193 May 17 11:59:44.337254 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 20/39] 10.222.0.58 () {60 vars in 1190 bytes} [Tue May 17 11:59:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 11:59:44.344043 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-08ac9461-2c72-4fa0-9ff8-60d065d9f870 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:44.364191 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-08ac9461-2c72-4fa0-9ff8-60d065d9f870 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024744 May 17 11:59:44.364741 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 20/40] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 17 11:59:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 11:59:44.374606 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-a0ac1c72-6558-4751-bf21-89e5538cda84 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:44.395965 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-a0ac1c72-6558-4751-bf21-89e5538cda84 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025157 May 17 11:59:44.396532 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 17 11:59:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 11:59:44.406321 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-8da15124-c558-47cb-86dc-b7d5918b722b admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:44.411663 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.wsgi [None req-8da15124-c558-47cb-86dc-b7d5918b722b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-8da15124-c558-47cb-86dc-b7d5918b722b admin admin] Request method failure captured: May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Accept: application/json May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Accept-Encoding: gzip, deflate May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Connection: keep-alive May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Content-Length: 0 May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Host: 10.222.0.58 May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Openstack-Api-Version: compute 2.90 May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Openstack-System-Scope: None May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: User-Agent: python-novaclient May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Auth-Token: gAAAAABig44wDb1f8x6eZXbonXXOM_ziQsB19Jy2kN5mTVvu91Q9ESTZ0Qkjc3YeOHATEWyavdeVEwfcYG9lAhYTw6dUCuwBUeFGoTnahRIV0RLELk58QzmiVPaCPhZba2J03VmEGrRPejzD2i2xRYKwMI8fuh4WNYUeVxMRFmMdbtF9xazezOo May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Domain-Id: None May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Domain-Name: None May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Identity-Status: Confirmed May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Is-Admin-Project: True May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Openstack-Nova-Api-Version: 2.90 May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Domain-Id: default May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Domain-Name: Default May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Name: admin May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Role: member,reader,admin May 17 11:59:44.414946 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Roles: member,reader,admin May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2acfce5cbf9f4de7bfe02428af601440", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}] May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Tenant: admin May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Tenant-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Tenant-Name: admin May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User: admin May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Domain-Id: default May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Domain-Name: Default May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Id: f0ae019bc4584bc39f9f7fb0d0af90e6 May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Name: admin May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: method: > May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: exception: Flavor 42 could not be found. May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: action_args: {'id': '42'} May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 11:59:44.416497 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:44.417506 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:44.418965 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-8da15124-c558-47cb-86dc-b7d5918b722b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 11:59:44.420440 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-8da15124-c558-47cb-86dc-b7d5918b722b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014286 May 17 11:59:44.420440 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1190 bytes} [Tue May 17 11:59:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 11:59:45.302030 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-a0ac1c72-6558-4751-bf21-89e5538cda84 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:45.303086 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-a0ac1c72-6558-4751-bf21-89e5538cda84 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 17 11:59:45.303433 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 22/43] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 11:59:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:45.491160 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-8b5fbac6-a4f8-43b2-abb8-68ef58e4dc23 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:45.496561 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.wsgi [None req-8b5fbac6-a4f8-43b2-abb8-68ef58e4dc23 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-8b5fbac6-a4f8-43b2-abb8-68ef58e4dc23 admin admin] Request method failure captured: May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Accept: application/json May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Accept-Encoding: gzip, deflate May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Connection: keep-alive May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Content-Length: 0 May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Host: 10.222.0.58 May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Openstack-Api-Version: compute 2.90 May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Openstack-System-Scope: None May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: User-Agent: python-novaclient May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Auth-Token: gAAAAABig44xXddkfU1rhErHoCR6tu3oejW1-az3jHfOTmn7h5X8J8iWyUjaM2aNAgDGFWtfHogAZTSh4eoujxgM7dNpKlctC4XWku0YEPoZaTFucqCsrFiCYlMcMjTQUVWf3ZU1LZhJJgv9FUIQqHikQZ5hX8bW_sh_5sefbOzUJLhQkOQials May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Domain-Id: None May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Domain-Name: None May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Identity-Status: Confirmed May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Is-Admin-Project: True May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Openstack-Nova-Api-Version: 2.90 May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Domain-Id: default May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Domain-Name: Default May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Name: admin May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Role: member,reader,admin May 17 11:59:45.498583 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Roles: member,reader,admin May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2acfce5cbf9f4de7bfe02428af601440", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}] May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Tenant: admin May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Tenant-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Tenant-Name: admin May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User: admin May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Domain-Id: default May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Domain-Name: Default May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Id: f0ae019bc4584bc39f9f7fb0d0af90e6 May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Name: admin May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: method: > May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: exception: Flavor 84 could not be found. May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: action_args: {'id': '84'} May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 11:59:45.499933 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:45.500729 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:45.501735 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-8b5fbac6-a4f8-43b2-abb8-68ef58e4dc23 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 11:59:45.502780 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-8b5fbac6-a4f8-43b2-abb8-68ef58e4dc23 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059646 May 17 11:59:45.502780 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1190 bytes} [Tue May 17 11:59:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 11:59:45.509758 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-ba1760dd-9cd4-4e9e-a224-f847885ba623 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:45.523767 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-ba1760dd-9cd4-4e9e-a224-f847885ba623 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017711 May 17 11:59:45.524332 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 23/45] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 17 11:59:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 11:59:45.533663 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-3cd29e22-6812-404b-b5aa-eef196d5b446 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:45.547377 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-3cd29e22-6812-404b-b5aa-eef196d5b446 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017283 May 17 11:59:45.547906 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 17 11:59:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 11:59:45.557144 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-f8673c27-6858-45aa-8981-9094489b71e5 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:45.563158 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.wsgi [None req-f8673c27-6858-45aa-8981-9094489b71e5 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-f8673c27-6858-45aa-8981-9094489b71e5 admin admin] Request method failure captured: May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Accept: application/json May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Accept-Encoding: gzip, deflate May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Connection: keep-alive May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Content-Length: 0 May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Host: 10.222.0.58 May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Openstack-Api-Version: compute 2.90 May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Openstack-System-Scope: None May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: User-Agent: python-novaclient May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Auth-Token: gAAAAABig44xXddkfU1rhErHoCR6tu3oejW1-az3jHfOTmn7h5X8J8iWyUjaM2aNAgDGFWtfHogAZTSh4eoujxgM7dNpKlctC4XWku0YEPoZaTFucqCsrFiCYlMcMjTQUVWf3ZU1LZhJJgv9FUIQqHikQZ5hX8bW_sh_5sefbOzUJLhQkOQials May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Domain-Id: None May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Domain-Name: None May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Identity-Status: Confirmed May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Is-Admin-Project: True May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Openstack-Nova-Api-Version: 2.90 May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Domain-Id: default May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Domain-Name: Default May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Name: admin May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Role: member,reader,admin May 17 11:59:45.564963 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Roles: member,reader,admin May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2acfce5cbf9f4de7bfe02428af601440", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}] May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Tenant: admin May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Tenant-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Tenant-Name: admin May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User: admin May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Domain-Id: default May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Domain-Name: Default May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Id: f0ae019bc4584bc39f9f7fb0d0af90e6 May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Name: admin May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: method: > May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: exception: Flavor 84 could not be found. May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: action_args: {'id': '84'} May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 11:59:45.566471 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:45.567540 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:45.568896 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-f8673c27-6858-45aa-8981-9094489b71e5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 11:59:45.570372 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-f8673c27-6858-45aa-8981-9094489b71e5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012796 May 17 11:59:45.570372 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 24/47] 10.222.0.58 () {60 vars in 1190 bytes} [Tue May 17 11:59:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 11:59:46.452803 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-3cd29e22-6812-404b-b5aa-eef196d5b446 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:46.453812 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-3cd29e22-6812-404b-b5aa-eef196d5b446 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 17 11:59:46.454212 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 24/48] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 11:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:46.641321 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-2bcc40a0-8f47-470e-b845-0c940a850aeb admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:46.647010 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.wsgi [None req-2bcc40a0-8f47-470e-b845-0c940a850aeb admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-2bcc40a0-8f47-470e-b845-0c940a850aeb admin admin] Request method failure captured: May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Accept: application/json May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Accept-Encoding: gzip, deflate May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Connection: keep-alive May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Content-Length: 0 May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Host: 10.222.0.58 May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Openstack-Api-Version: compute 2.90 May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Openstack-System-Scope: None May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: User-Agent: python-novaclient May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Auth-Token: gAAAAABig44yA4qeXXIOzX1TVmc3aETYDW3esmNNqaf9EZRwerxPpOl7MJcf1m8GjEIy8dtB7oaEwtPhTb8DAew3kROmbHGRIFCzhT1-1QjzgcSenJBi0p8uCW75pEhx3JikDQ5VOq1Lta3nRk8etIuw5LG8ScW0cIrNJ8wp0jDHZfcQois9iPw May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Domain-Id: None May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Domain-Name: None May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Identity-Status: Confirmed May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Is-Admin-Project: True May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Openstack-Nova-Api-Version: 2.90 May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Domain-Id: default May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Domain-Name: Default May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Project-Name: admin May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Role: member,reader,admin May 17 11:59:46.648568 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Roles: member,reader,admin May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2acfce5cbf9f4de7bfe02428af601440", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}] May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Tenant: admin May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Tenant-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-Tenant-Name: admin May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User: admin May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Domain-Id: default May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Domain-Name: Default May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Id: f0ae019bc4584bc39f9f7fb0d0af90e6 May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: X-User-Name: admin May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: method: > May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: exception: Flavor 451 could not be found. May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: action_args: {'id': '451'} May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 11:59:46.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:46.651073 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: ERROR nova.api.openstack.wsgi May 17 11:59:46.652477 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-2bcc40a0-8f47-470e-b845-0c940a850aeb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102782) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 11:59:46.654367 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-2bcc40a0-8f47-470e-b845-0c940a850aeb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060013 May 17 11:59:46.654367 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 25/49] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 17 11:59:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 11:59:46.660326 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-78a64868-bbc3-4e00-b709-4dfede748754 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:46.673923 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-78a64868-bbc3-4e00-b709-4dfede748754 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017078 May 17 11:59:46.674376 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 25/50] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 17 11:59:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 11:59:46.683620 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:46.697708 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017630 May 17 11:59:46.698250 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 26/51] 10.222.0.58 () {60 vars in 1210 bytes} [Tue May 17 11:59:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 11:59:46.708042 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-4799a274-ec37-45af-a3a7-829488d8427f admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:46.713213 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.wsgi [None req-4799a274-ec37-45af-a3a7-829488d8427f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-4799a274-ec37-45af-a3a7-829488d8427f admin admin] Request method failure captured: May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Accept: application/json May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Accept-Encoding: gzip, deflate May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Connection: keep-alive May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Content-Length: 0 May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Host: 10.222.0.58 May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Openstack-Api-Version: compute 2.90 May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Openstack-System-Scope: None May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: User-Agent: python-novaclient May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Auth-Token: gAAAAABig44yA4qeXXIOzX1TVmc3aETYDW3esmNNqaf9EZRwerxPpOl7MJcf1m8GjEIy8dtB7oaEwtPhTb8DAew3kROmbHGRIFCzhT1-1QjzgcSenJBi0p8uCW75pEhx3JikDQ5VOq1Lta3nRk8etIuw5LG8ScW0cIrNJ8wp0jDHZfcQois9iPw May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Domain-Id: None May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Domain-Name: None May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Identity-Status: Confirmed May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Is-Admin-Project: True May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Openstack-Nova-Api-Version: 2.90 May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Domain-Id: default May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Domain-Name: Default May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Project-Name: admin May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Role: member,reader,admin May 17 11:59:46.714740 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Roles: member,reader,admin May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2acfce5cbf9f4de7bfe02428af601440", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2acfce5cbf9f4de7bfe02428af601440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2acfce5cbf9f4de7bfe02428af601440"}]}] May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Tenant: admin May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Tenant-Id: 2acfce5cbf9f4de7bfe02428af601440 May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-Tenant-Name: admin May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User: admin May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Domain-Id: default May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Domain-Name: Default May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Id: f0ae019bc4584bc39f9f7fb0d0af90e6 May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: X-User-Name: admin May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: method: > May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: exception: Flavor 451 could not be found. May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: action_args: {'id': '451'} May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 11:59:46.716970 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:46.717905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: ERROR nova.api.openstack.wsgi May 17 11:59:46.719341 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-4799a274-ec37-45af-a3a7-829488d8427f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 11:59:46.720549 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-4799a274-ec37-45af-a3a7-829488d8427f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012219 May 17 11:59:46.720549 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 26/52] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 17 11:59:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 11:59:47.603514 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:47.604548 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 17 11:59:47.604939 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 27/53] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 11:59:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:47.791919 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-898ab3ca-21fa-4594-aeb7-747be923beed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:47.808978 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-898ab3ca-21fa-4594-aeb7-747be923beed admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067566 May 17 11:59:47.810151 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 27/54] 10.222.0.58 () {64 vars in 1235 bytes} [Tue May 17 11:59:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 11:59:48.722503 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:48.723506 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 17 11:59:48.723906 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 28/55] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 11:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:48.910366 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-86454fb9-1ea7-4b10-8fc0-88c9c6364a17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:48.928173 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-86454fb9-1ea7-4b10-8fc0-88c9c6364a17 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068227 May 17 11:59:48.928762 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 28/56] 10.222.0.58 () {64 vars in 1235 bytes} [Tue May 17 11:59:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 11:59:49.811899 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:49.812941 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 17 11:59:49.813375 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 29/57] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 11:59:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:50.002859 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-16710c02-29c3-4b4c-9000-8cf19cc7112f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:50.020385 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-16710c02-29c3-4b4c-9000-8cf19cc7112f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067927 May 17 11:59:50.020934 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 29/58] 10.222.0.58 () {64 vars in 1235 bytes} [Tue May 17 11:59:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 11:59:50.913719 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:50.914697 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 17 11:59:50.915086 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 30/59] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 11:59:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 11:59:51.102927 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-0e718914-80b9-41a2-a148-63213fcef4a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 11:59:51.120145 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-0e718914-80b9-41a2-a148-63213fcef4a2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068468 May 17 11:59:51.120701 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 30/60] 10.222.0.58 () {64 vars in 1235 bytes} [Tue May 17 11:59:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 11:59:52.014054 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:52.015118 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 17 11:59:52.015519 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 31/61] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 11:59:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 11:59:52.201338 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-10222843-c7cc-4666-89c2-d10f78c59605 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 11:59:52.220789 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-10222843-c7cc-4666-89c2-d10f78c59605 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070348 May 17 11:59:52.221324 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 31/62] 10.222.0.58 () {60 vars in 1202 bytes} [Tue May 17 11:59:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:00:54.421988 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:00:54.422997 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-7415e7bd-c033-4642-82a3-941e6235a99e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 17 12:00:54.423398 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 32/63] 10.222.0.58 () {54 vars in 930 bytes} [Tue May 17 12:00:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:00:54.480498 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-0c63eb78-e8aa-4e17-bf46-705d4569f0e2 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:00:54.499924 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-0c63eb78-e8aa-4e17-bf46-705d4569f0e2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070763 May 17 12:00:54.500518 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 32/64] 10.222.0.58 () {60 vars in 1291 bytes} [Tue May 17 12:00:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:00:54.523141 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-06f12252-a989-4346-a7b0-1b343b2dbaf4 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:00:54.530983 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-06f12252-a989-4346-a7b0-1b343b2dbaf4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012120 May 17 12:00:54.531528 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 33/65] 10.222.0.58 () {60 vars in 1282 bytes} [Tue May 17 12:00:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:00:54.542816 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-2f540609-d628-4042-b2c9-dbec5eaed3f4 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:00:54.550398 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-2f540609-d628-4042-b2c9-dbec5eaed3f4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011170 May 17 12:00:54.550905 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 33/66] 10.222.0.58 () {60 vars in 1285 bytes} [Tue May 17 12:00:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:00:54.562438 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-df6c3883-0518-4442-aeb8-009a707052d6 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:00:54.570129 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-df6c3883-0518-4442-aeb8-009a707052d6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011329 May 17 12:00:54.570638 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 34/67] 10.222.0.58 () {60 vars in 1285 bytes} [Tue May 17 12:00:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:00:54.581958 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-04a344ad-865b-431e-a2d9-6f3bed54a45c admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:00:54.589485 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-04a344ad-865b-431e-a2d9-6f3bed54a45c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010928 May 17 12:00:54.590016 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 34/68] 10.222.0.58 () {60 vars in 1282 bytes} [Tue May 17 12:00:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:04:15.566275 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-df6c3883-0518-4442-aeb8-009a707052d6 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:04:15.567560 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-df6c3883-0518-4442-aeb8-009a707052d6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 17 12:04:15.567952 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 35/69] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 12:04:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:04:15.836223 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-0782172c-34ea-425b-9ea9-d28322a70bba admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:04:15.837401 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 12:04:15.837401 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: warnings.warn(msg) May 17 12:04:15.838615 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-0782172c-34ea-425b-9ea9-d28322a70bba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:04:15.839148 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-0782172c-34ea-425b-9ea9-d28322a70bba admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:04:15.839928 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-0782172c-34ea-425b-9ea9-d28322a70bba admin admin] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:04:15.840402 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-0782172c-34ea-425b-9ea9-d28322a70bba admin admin] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:04:15.875213 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-0782172c-34ea-425b-9ea9-d28322a70bba admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152586 May 17 12:04:15.875785 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 35/70] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 17 12:04:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 12:04:16.774927 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-df6c3883-0518-4442-aeb8-009a707052d6 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:04:16.776163 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-df6c3883-0518-4442-aeb8-009a707052d6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 17 12:04:16.776687 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 12:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:04:16.970767 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-55a1bbaa-0746-41f9-94df-3b13fcd375f7 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:04:16.971950 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 12:04:16.971950 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: warnings.warn(msg) May 17 12:04:16.973167 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-55a1bbaa-0746-41f9-94df-3b13fcd375f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:04:16.973609 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-55a1bbaa-0746-41f9-94df-3b13fcd375f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:04:16.974391 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-55a1bbaa-0746-41f9-94df-3b13fcd375f7 admin admin] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:04:16.974823 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-55a1bbaa-0746-41f9-94df-3b13fcd375f7 admin admin] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:04:16.993869 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-55a1bbaa-0746-41f9-94df-3b13fcd375f7 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074234 May 17 12:04:16.994413 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 36/72] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 17 12:04:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 12:04:28.334983 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-df6c3883-0518-4442-aeb8-009a707052d6 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:04:28.335981 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-df6c3883-0518-4442-aeb8-009a707052d6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 17 12:04:28.336416 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 37/73] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 12:04:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:04:28.526654 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-cdc7f07b-b928-4201-a57d-328108835614 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:04:28.527843 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 12:04:28.527843 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: warnings.warn(msg) May 17 12:04:28.529077 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-cdc7f07b-b928-4201-a57d-328108835614 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:04:28.529526 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-cdc7f07b-b928-4201-a57d-328108835614 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:04:28.530349 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-cdc7f07b-b928-4201-a57d-328108835614 admin admin] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:04:28.530782 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-cdc7f07b-b928-4201-a57d-328108835614 admin admin] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:04:28.556750 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-cdc7f07b-b928-4201-a57d-328108835614 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082522 May 17 12:04:28.557218 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 37/74] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 17 12:04:28 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:04:29.439868 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: DEBUG nova.api.openstack.wsgi [None req-df6c3883-0518-4442-aeb8-009a707052d6 admin admin] Calling method '>' {{(pid=102782) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:04:29.440920 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: INFO nova.api.openstack.requestlog [None req-df6c3883-0518-4442-aeb8-009a707052d6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 17 12:04:29.441328 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: [pid: 102782|app: 0|req: 38/75] 10.222.0.58 () {56 vars in 1074 bytes} [Tue May 17 12:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:04:29.674044 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG nova.api.openstack.wsgi [None req-f238c693-3630-4e1e-a615-474ed0d39bd9 admin admin] Calling method '>' {{(pid=102781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:04:29.675221 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 12:04:29.675221 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: warnings.warn(msg) May 17 12:04:29.677240 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-f238c693-3630-4e1e-a615-474ed0d39bd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:04:29.677846 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-f238c693-3630-4e1e-a615-474ed0d39bd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:04:29.678650 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-f238c693-3630-4e1e-a615-474ed0d39bd9 admin admin] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:04:29.679110 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: DEBUG oslo_concurrency.lockutils [None req-f238c693-3630-4e1e-a615-474ed0d39bd9 admin admin] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:04:29.702109 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: INFO nova.api.openstack.requestlog [None req-f238c693-3630-4e1e-a615-474ed0d39bd9 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081531 May 17 12:04:29.702689 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: [pid: 102781|app: 0|req: 38/76] 10.222.0.58 () {60 vars in 1193 bytes} [Tue May 17 12:04:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:05:27.859104 dv-cinder-837699-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 17 12:05:27.859860 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: Tue May 17 12:05:27 2022 - graceful shutdown triggered... May 17 12:05:27.860395 dv-cinder-837699-7-iscsi devstack@n-api.service[102782]: Gracefully killing worker 2 (pid: 102782)... May 17 12:05:27.860761 dv-cinder-837699-7-iscsi devstack@n-api.service[102781]: Gracefully killing worker 1 (pid: 102781)... May 17 12:05:28.860986 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: worker 1 buried after 1 seconds May 17 12:05:28.860986 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: worker 2 buried after 1 seconds May 17 12:05:28.860986 dv-cinder-837699-7-iscsi devstack@n-api.service[102780]: goodbye to uWSGI. May 17 12:05:28.862582 dv-cinder-837699-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 17 12:05:28.863144 dv-cinder-837699-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 17 12:05:28.865835 dv-cinder-837699-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 12:05:28.880123 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 12:05:28.905738 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 12:05:28 2022] *** May 17 12:05:28.905738 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 12:05:28.905738 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 12:05:28.905738 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: nodename: dv-cinder-837699-7-iscsi May 17 12:05:28.905738 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: machine: x86_64 May 17 12:05:28.905738 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: clock source: unix May 17 12:05:28.905738 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: pcre jit disabled May 17 12:05:28.905738 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: detected number of CPU cores: 4 May 17 12:05:28.905738 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: current working directory: / May 17 12:05:28.905738 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: detected binary path: /usr/bin/uwsgi-core May 17 12:05:28.906521 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: your processes number limit is 47680 May 17 12:05:28.906521 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: your memory page size is 4096 bytes May 17 12:05:28.906521 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: detected max file descriptor number: 2048 May 17 12:05:28.906521 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: lock engine: pthread robust mutexes May 17 12:05:28.906521 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: thunder lock: enabled May 17 12:05:28.906521 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 12:05:28.906521 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 12:05:28.952500 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: Python main interpreter initialized at 0x55c87ef029c0 May 17 12:05:28.952500 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: python threads support enabled May 17 12:05:28.952500 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: your server socket listen backlog is limited to 100 connections May 17 12:05:28.952500 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: your mercy for graceful operations on workers is 90 seconds May 17 12:05:28.952956 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: mapped 403077 bytes (393 KB) for 2 cores May 17 12:05:28.952956 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: *** Operational MODE: preforking *** May 17 12:05:28.953207 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: *** uWSGI is running in multiple interpreter mode *** May 17 12:05:28.953207 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: spawned uWSGI master process (pid: 117101) May 17 12:05:28.953417 dv-cinder-837699-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 12:05:28.953961 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: spawned uWSGI worker 1 (pid: 117113, cores: 1) May 17 12:05:28.954473 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: spawned uWSGI worker 2 (pid: 117114, cores: 1) May 17 12:05:28.954757 dv-cinder-837699-7-iscsi devstack@n-api.service[117101]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 12:05:30.315778 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 12:05:30.328310 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 12:05:31.141548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 12:05:31.141548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: from cryptography.utils import int_from_bytes May 17 12:05:31.141882 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 12:05:31.141882 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: from cryptography.utils import int_from_bytes May 17 12:05:31.179373 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 12:05:31.179373 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: from cryptography.utils import int_from_bytes May 17 12:05:31.179665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 12:05:31.179665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: from cryptography.utils import int_from_bytes May 17 12:05:33.618076 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 12:05:33.618752 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 12:05:33.618881 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 12:05:33.619536 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 12:05:33.619964 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 12:05:33.620392 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.620732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.621066 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.621396 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.621738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.622059 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.622389 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.622724 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.623062 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.623329 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.623656 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.623990 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-7-iscsi {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.624347 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.624668 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.624989 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.625315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.625630 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.625964 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.626279 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.626791 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.627540 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.627858 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.628248 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.628567 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.628895 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.629216 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.629544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.629863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.630194 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.630514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.630918 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-7-iscsi {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.631245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.631569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.631892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.632348 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.632672 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.632990 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.633322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.633606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 12:05:33.633999 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.634098 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 12:05:33.634191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.634286 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.634410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 12:05:33.634626 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.634954 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.635077 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 12:05:33.635283 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.635384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 12:05:33.635594 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.635735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.635911 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.636074 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.636255 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.636534 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.636626 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.636871 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.636973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.637192 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.637304 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.637461 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.637604 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.637763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.637872 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.638092 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.638193 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.638419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.638530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.638749 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.638843 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.639009 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.639110 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.639283 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.639393 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-7-iscsi {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.639588 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.639748 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.639917 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.640020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.640255 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.640366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.640574 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.640667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.640890 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.641007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.641202 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.641303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.641515 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.641607 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.641828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.642079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.642191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.642402 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.642503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.642719 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.642811 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.643090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.643207 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.643379 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.643472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.643692 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.643782 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.644013 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.644115 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.644376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.644520 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.644695 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.644795 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.645012 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.645113 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.645331 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.645432 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.645672 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.645784 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-7-iscsi {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.645988 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.646091 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.646321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.646422 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.646649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.646751 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.646964 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.647068 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.647283 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.647408 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.647598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.647725 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.647926 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.648023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.648279 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.648394 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.648597 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.648702 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.648856 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.648964 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.649165 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.649299 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.649478 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.649628 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.649806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.649959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.650122 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.650954 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.651252 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.651443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.651591 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.651758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.651919 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.652077 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.652278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.652420 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.652600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.652737 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.652919 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.653053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.653188 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.653371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.653545 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.653690 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.653839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.654006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.654174 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.654321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.654508 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.654638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.654769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.654966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.655067 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.655296 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.655401 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.655614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.655722 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.655928 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.656024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.656268 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.656390 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.656586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.656690 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.656918 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.657026 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.657231 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.657395 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.657545 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.657637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.657866 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.658012 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.658182 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.658295 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.658495 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.658589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.658819 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.658925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.659132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.659235 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.659448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.659549 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.659775 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.659882 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.660085 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.660208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.660427 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.660530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.660755 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.660871 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.661073 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.661184 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.661389 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.661484 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.661701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.661796 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.662011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.662107 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.662325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.662430 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.662637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.662740 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.662950 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.663064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.663278 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.663422 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.663571 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.663672 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.663894 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.663998 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.664229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.664324 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.664496 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.664615 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.664814 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.664924 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.665130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.665237 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.665462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.665558 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.665828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.666561 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.666906 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.667335 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.667492 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.667669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.667803 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.668043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.668212 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.668366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.668465 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.668652 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.668746 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.668976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.669076 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.669299 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.669400 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.669621 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.669722 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.669941 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.670044 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.670265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.670376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.670583 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.670675 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.670900 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.671002 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.671226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.671337 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.671556 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.671657 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.671877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.671979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.672220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.672330 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.672548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.672643 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.672851 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.672946 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.673175 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.673276 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.673490 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.673582 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.673807 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.673901 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.674137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.674235 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.674455 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.674556 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.674778 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.674881 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.675108 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.675215 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.675427 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.675519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.675744 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.675836 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.676075 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.676175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.676417 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.676560 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.676738 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.676881 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.677067 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.677172 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.677383 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.677524 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.677702 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.677802 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.678015 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.678132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.678332 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.678447 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.678646 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.678746 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.678961 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.679070 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.679276 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.679369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.679589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.679682 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.679902 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.680007 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.680252 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.680362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.680577 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.680668 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.680897 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.681003 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.681214 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.681380 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.681573 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.681680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.681896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.682138 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 12:05:33.682233 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.682506 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.682600 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.682818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.682917 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.683132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.683279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.683450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.683543 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.683765 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.683861 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.684094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.684211 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.684461 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.684554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.684777 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.684887 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.685120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.685213 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.685434 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.685576 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.685752 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.685855 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.686072 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.686176 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.686390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.686484 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.686710 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.686817 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.687026 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.687120 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.687344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.687447 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.687657 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.687750 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.687986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.688088 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.688326 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.688488 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.688640 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.688735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.688968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.689068 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.689280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.689378 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.689594 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.689695 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.689914 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.690014 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.690232 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.690324 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.690548 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.690649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.690867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.690959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.691185 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.691287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.691514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.691615 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.691837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.691937 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.692156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.692322 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.692517 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.692617 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.692851 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.692953 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.693428 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.693534 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.693761 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.693862 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.694088 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.694179 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.694412 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.694516 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.694727 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.694819 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.695045 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.695143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.695355 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.695457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.695666 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.695760 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.695979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.696071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.696333 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.696444 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.696650 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.696743 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.696962 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.697070 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.697484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.697803 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.697900 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.698118 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.698222 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.698452 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.698559 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.698773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.698876 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.699088 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.699180 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.699402 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.699504 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.699715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.699808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.700038 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.700137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.700384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.700479 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.700716 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.700808 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.701053 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.701153 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.701375 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.701468 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.701712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.701830 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.702027 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.702145 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.702351 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.702454 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.702668 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.702759 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.702988 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.703080 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.703304 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.703398 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.703623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.703724 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.703943 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.704048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.704285 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.704400 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.704616 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.704716 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.704935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.705042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.705251 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.705397 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.705576 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.705669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.705894 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.705997 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.706206 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.706305 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.706530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.706628 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.706852 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.706964 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.707174 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.707275 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.707498 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.707635 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.707819 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.707922 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.708135 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.708240 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.708495 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.708590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.708816 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.708912 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.709131 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.709229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.709448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.709540 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.709768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.709870 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.710094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.710196 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.710414 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.710513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.710739 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.710831 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.711059 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.711150 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.711380 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.711482 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.711696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.711787 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.712008 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.712100 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.712346 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.712454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.713171 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.713307 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.713675 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.713848 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.714017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.714157 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.714337 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.714552 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.714645 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.714920 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.715021 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.715242 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.715343 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.715581 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.715677 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.715899 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.716004 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.716233 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.716342 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.716547 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.716638 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.716862 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.716967 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.717183 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.717275 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.717503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.717597 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.717823 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.717930 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.718139 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.718285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.718463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.718556 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.718782 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.718927 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.719097 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.719204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.719408 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.719501 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.719727 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.719820 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.720058 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.720150 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.720404 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.720511 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.720729 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.720867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.721060 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.721159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.721377 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.721476 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.721690 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.721783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.722015 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.722114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.722334 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.722424 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.722647 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.722747 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.722959 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.723052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.723270 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.723363 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.723595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.723695 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.723931 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.724027 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.724268 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.724383 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.724600 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.724693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.724929 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.725021 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.725249 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.725351 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.725570 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.725662 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.725888 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.726033 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.726210 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.726317 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.726532 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.726625 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.726851 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.726942 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.727169 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.727272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.727488 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.727581 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.727807 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.727943 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.728125 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.728232 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.729107 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.729393 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.729643 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.729744 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.729926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.730021 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.730267 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.730361 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.730593 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.730696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.730924 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.731019 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.731248 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.731338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.731607 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.731831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.731932 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.732172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.732338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.732589 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.732686 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.732918 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.733021 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.733246 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.733346 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.733574 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.733676 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.733911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.734044 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.734232 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.734369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.734556 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.734649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.734887 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.734992 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.735206 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.735307 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.735518 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.735654 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.735834 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.735933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.736151 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.736329 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.736498 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.736597 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.736809 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.736945 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.737123 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.737228 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.737440 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.737531 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.737754 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.737855 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.738068 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.738206 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.738381 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.738474 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.738696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.738796 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.739019 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.739127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.739333 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.739428 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.739680 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.739790 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.739956 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.740068 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.740301 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.740441 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.740620 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.740711 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.740934 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.741029 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.741243 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.741340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.741556 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.741651 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.741901 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.742003 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.742215 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.742306 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.742550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.742650 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.742872 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.742967 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.743197 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.743298 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.743521 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.743629 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.743833 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.743968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.744248 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.744569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.744786 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.744931 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.745099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.745203 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.745428 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.745521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.745755 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.745857 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.746073 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.746173 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.746393 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.746495 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.746712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.746805 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.747028 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.747130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.747346 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.747446 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.747657 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.747767 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.747974 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.748066 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.748310 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.748419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.748634 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.748730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.748951 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.749043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.749264 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.749530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.749633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.749878 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.749980 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.750191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.750283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.750501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.750596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.750818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.750911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.751129 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.751229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.751453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.751547 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.751766 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.751867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.752079 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.752198 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.752428 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.752536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.752745 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.752856 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.753062 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.753154 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.753374 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.753474 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.753704 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.753811 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.754019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.754119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.754328 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.754419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.754641 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.754743 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.754954 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.755055 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.755266 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.755366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.755579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.755680 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.755890 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.755980 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.756223 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.756370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.756555 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.756653 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.756866 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.756959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.757184 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.757286 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.757498 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.757592 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.757812 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.757905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.758125 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.758217 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.758435 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.758540 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.758744 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.758839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.759053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.759153 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.759363 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.759464 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.759701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.759960 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.760057 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.760366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.760574 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.760688 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.760920 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.761015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.761280 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.761386 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.761593 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.761693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.761912 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.762005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.762247 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.762354 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.762562 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.762663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.762879 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.762977 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.763196 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.763299 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.763519 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.763613 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.763841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.763941 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.764159 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.764323 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.764503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.764605 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.764816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.764918 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.765138 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.765233 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.765457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.765549 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.765772 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.765871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.766082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.766182 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.766396 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.766487 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.766722 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.766816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.767042 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.767134 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.767355 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.767457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.767669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.767771 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.767989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.768082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.768330 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.768464 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.768647 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.768784 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.768967 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.769062 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.769282 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.769384 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.769601 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.769702 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.769914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.770006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.770229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.770329 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.770548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.770678 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.770870 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.770977 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.771184 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.771276 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.771498 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.771594 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.771815 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.771907 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.772130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.772290 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.772472 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.772573 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.772789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.772935 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.773103 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.773225 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.773415 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.773519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.773729 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.773831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.774044 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.774208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.774362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.774457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.774674 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.774776 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.774997 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.775103 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.775986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.776318 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.776467 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.776652 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.776792 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.776972 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.777114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.777292 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.777429 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.777615 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.777749 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.777932 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.778069 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.778248 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.778393 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.778563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.778719 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.778880 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.779034 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.779195 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.779457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.779550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.779778 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.779872 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.780096 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.780219 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.780441 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.780533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.780754 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.780849 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.781067 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.781159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.781385 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.781486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.781717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.781819 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.782031 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.782132 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.782348 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.782449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.782663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.782756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.782996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.783097 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.783311 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.783413 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.783634 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.783729 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.783952 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.784045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.784319 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.784436 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.784647 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.784741 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.784972 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.785135 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.785289 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.785455 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.785606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.785774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.785939 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.786104 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.786265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.786434 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.786591 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.786768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.786925 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.787082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.787259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.787405 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.787598 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.787723 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.787916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.788056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.788259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.788414 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.788585 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.788735 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.788912 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.789069 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.789233 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.789381 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.789554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.789715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.789877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.790046 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.790200 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.790369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.790521 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.790700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.791482 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.791701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.792039 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.792364 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.792472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.792693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.792794 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.793023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.793117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.793337 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.793429 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.793653 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.793753 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.793975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.794069 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.794290 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.794382 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.794607 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.794707 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.794934 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.795062 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.795253 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.795346 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.795572 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.795676 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.795887 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.795987 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.796228 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.796341 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.796550 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.796662 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.796866 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.796968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.797201 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.797309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.797515 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.797612 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.797847 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.797941 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.798172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.798283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.798503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.798596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.798825 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.798954 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.799137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.799248 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.799469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.799562 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.799788 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.799889 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.800100 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.800216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.800439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.800532 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.800755 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.800848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.801106 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.801211 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.801419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.801510 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.801745 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.801837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.802061 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.802163 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.802377 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.802470 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.802712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.802811 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.803028 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.803120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.803361 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.803490 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.803687 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.803821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.804013 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.804108 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.804378 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.804473 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.804692 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.804849 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.805010 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.805174 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.805329 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.805498 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.805642 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.805833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.805955 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.806160 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.806724 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.806866 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.807029 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.807029 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.807327 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.807430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.807586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.807726 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.807817 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.807916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.808109 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.808255 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.808469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.808572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.808787 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.808891 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.809099 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.809237 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.809414 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.809517 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.809727 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.809828 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.810078 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.810172 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.810391 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.810527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.810734 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.810839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.811059 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.811185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.811390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.811524 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.811727 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.811851 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.812048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.812202 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.812407 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.812544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.812732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.812864 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.813056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.813183 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.813379 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.813508 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.813700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.813829 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.814023 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.814150 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.814344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.814493 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.814663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.814815 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.814983 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.815139 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.815306 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.815461 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.815625 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.815783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.815948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.816102 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.816468 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.816574 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.816808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.816901 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.817129 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.817223 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.817457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.817558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.817779 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.817883 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.818374 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.818474 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.818697 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.818792 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.819014 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.819107 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.819333 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.819433 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.819654 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.819750 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.819969 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.820060 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.820308 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.820424 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.820628 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.820730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.820969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.821068 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.821293 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.821393 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.821626 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.821718 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.821952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.822077 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.822304 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.822712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.822804 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.823065 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.823157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.823397 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.823500 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.823716 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.823810 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.824041 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.824142 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.824395 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.824503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.824727 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.824828 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.825046 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.825147 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.825361 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.825462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.825682 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.825782 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.825997 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.826097 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.826316 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.826412 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.826632 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.826733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.826951 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.827051 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.827264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.827357 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.827579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.827688 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.827896 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.828080 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.828267 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.828388 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.828560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.828696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.828897 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.829035 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.829219 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.829350 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.829535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.829763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.829892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.830096 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.830217 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.830442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.830569 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.830780 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.830901 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.831119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.831248 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.831446 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.831564 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.831773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.831898 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.832109 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.832256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.832953 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.833111 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.833241 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.833241 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.833537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.833704 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.833853 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.834079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.834215 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.834425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.834550 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.834750 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.834847 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.835088 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.835228 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.835425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.835529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.835758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.835968 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.836091 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.836366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.836478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.836696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.836790 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.837034 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.837135 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.837371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.837479 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.838238 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.838648 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.839132 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.839226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.839489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.839583 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.839827 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.839981 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.840156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.840310 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.840507 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.840611 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.840827 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.840929 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.841146 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.841247 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.841469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.841572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.841790 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.841883 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.842104 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.842206 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.842426 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.842519 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.842740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.842835 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.843078 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.843271 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.843395 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.843489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.843711 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.843815 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.844027 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.844130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.844387 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.844493 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.844700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.844803 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.845016 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.845110 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.845335 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.845435 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.845649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.845743 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.845970 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.846064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.846285 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.846386 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.846605 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.846699 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.846922 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.847016 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.847241 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.847342 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.847555 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.847661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.847871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.847973 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.848209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.848305 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.848540 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.848648 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.848863 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.848956 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.849184 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.849276 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.849509 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.849615 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.849830 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.849923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.850159 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.850254 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.850480 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.850591 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.850799 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.850892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.851124 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.851217 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.851453 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.851547 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.851985 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.852077 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.852345 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.852455 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.852675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.852778 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.853015 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.853116 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.853463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.853586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.853899 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.854184 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.854281 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.854524 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.854618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.854856 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.854993 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.855180 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.855277 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.855507 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.855598 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.855828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.855963 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.856151 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.856315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.856552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.856718 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.856880 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.857039 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.857203 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.857355 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.857505 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.857653 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.857813 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.857965 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.858113 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.858261 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.858419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.858591 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.858751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.858941 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.859110 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.859268 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.859418 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.859578 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.859710 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.859908 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.860005 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.860260 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.860473 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.860579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.860813 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.860915 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.861136 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.861237 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.861457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.861551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.861776 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.861871 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.862096 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.862189 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.862421 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.862523 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.862753 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.862855 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.863074 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.863205 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.863388 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.863483 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.863704 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.863839 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.864028 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.864121 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.864543 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.864674 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.864837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.864960 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.865163 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.865303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.865503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.865624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.865835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.865957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.866198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.866337 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.866460 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.866603 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.866777 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.866873 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.867096 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.867203 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.867415 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.867510 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.867738 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.867832 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.868055 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.868157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.868413 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.868638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.868760 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.869490 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.869658 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.869791 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.870116 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.870348 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.870453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.870683 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.870830 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.871051 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.871152 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.871366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.871458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.871684 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.871792 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.871998 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.872092 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.872359 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.872501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.872690 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.872812 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.873028 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.873150 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.873497 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.873618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.873749 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.874023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.874171 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.874353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.874454 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.874716 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.874907 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.875052 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.875259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.875429 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.875591 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.875761 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.875944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.876090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.876313 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.876615 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.876724 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.876945 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.877044 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.877265 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.877359 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.877585 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.877679 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.877905 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.878001 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.878226 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.878361 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.878547 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.878642 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.878872 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.878976 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.879195 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.879291 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.879517 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.879620 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.879842 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.879940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.880166 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.880298 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.880511 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.880626 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.880825 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.880921 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.881146 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.881241 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.881469 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.881576 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.881794 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.881894 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.882147 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.882248 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.882477 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.882580 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.882797 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.882889 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.883120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.883220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.883445 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.883538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.883786 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.883926 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.884092 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.884291 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.884441 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.884826 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.885154 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.885401 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.885504 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.885751 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.885862 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.886107 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.886202 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.886436 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.886538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.886756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.886928 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.887196 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.887290 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.887524 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.887626 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.887855 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.887950 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.888202 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.888312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.888523 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.888616 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.888844 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.888939 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.889167 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.889269 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.889490 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.889593 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.889824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.889919 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.890203 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.890311 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.890462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.890566 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.890797 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.890898 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.891132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.891229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.891478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.891586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.891797 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.891898 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.892113 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.892230 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.892458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.892561 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.892832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.892937 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.893109 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.893213 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.893431 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.893573 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.893749 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.893894 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 12:05:33.894071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.894394 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.894711 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.895025 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.895340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.895657 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.895984 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.896326 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.896640 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.896956 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.897272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.897588 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.897902 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.898222 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.898537 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.898851 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.899165 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.899478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.899793 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.900139 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.901082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.901417 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.901758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.902086 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.902426 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.902749 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.903086 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.903421 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.903750 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.904284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.904637 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.904965 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.905292 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.905619 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.905949 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.906272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.906595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.906938 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.907276 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.907595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.907933 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.908681 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.908681 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.908933 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.909256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.909732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.909921 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.910269 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.910564 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.910886 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.911207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.911533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.911864 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.912825 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.913422 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.913736 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.914080 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.914425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.914796 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.915127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.915490 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.916429 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.917397 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.917869 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.918062 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 12:05:33.918322 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 12:05:33.918420 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_db.sqlalchemy.engines [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 12:05:33.942365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 12:05:33.984857 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.context [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09ab1f8a-4b58-4541-9d13-ce3277a151d2(cell1) {{(pid=117113) load_cells /opt/stack/nova/nova/context.py:464}} May 17 12:05:33.989512 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:05:33.991378 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:05:33.992369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:05:33.995236 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:05:34.010275 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_db.sqlalchemy.engines [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 12:05:34.012155 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_db.sqlalchemy.engines [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 12:05:34.013279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.context [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09ab1f8a-4b58-4541-9d13-ce3277a151d2(cell1) {{(pid=117114) load_cells /opt/stack/nova/nova/context.py:464}} May 17 12:05:34.018030 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:05:34.019673 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:05:34.020616 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:05:34.022666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:05:34.035208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 12:05:34.037674 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 12:05:34.173695 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_db.sqlalchemy.engines [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 12:05:34.204928 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_db.sqlalchemy.engines [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 12:05:34.499497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: WARNING keystonemiddleware.auth_token [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 12:05:34.507129 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: WARNING keystonemiddleware.auth_token [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 12:05:34.532811 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: WARNING keystonemiddleware.auth_token [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 12:05:34.540052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: WARNING keystonemiddleware.auth_token [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 12:05:34.861691 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: WARNING keystonemiddleware.auth_token [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 12:05:34.867932 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: WARNING keystonemiddleware.auth_token [None req-99ca1003-7e74-4fc6-a227-02ee6d66bd84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 12:05:34.873190 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c87ef029c0 pid: 117113 (default app) May 17 12:05:34.888715 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: WARNING keystonemiddleware.auth_token [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 12:05:34.894887 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: WARNING keystonemiddleware.auth_token [None req-fc3348fb-5a0d-4ed0-b917-d0d54784842e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 12:05:34.900815 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c87ef029c0 pid: 117114 (default app) May 17 12:06:16.965375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a5e3f485-a812-4100-9ac9-adf3dc65fdb8 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Action: 'create', calling method: .version_select at 0x7f2db631a280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-851322335"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:18.505273 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a5e3f485-a812-4100-9ac9-adf3dc65fdb8 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.284316 May 17 12:06:18.514999 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1154 bytes} [Tue May 17 12:06:16 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2296 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 12:06:18.874745 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-237955600", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "networks": [{"uuid": "28200dd7-aadf-4f9b-9f6f-2c9ce6f8ad25"}]}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:18.927050 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-71ced1f1-478c-4de3-ba01-e2f7fc32f049 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db6346f70>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:19.088734 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] validate_networks() for [('28200dd7-aadf-4f9b-9f6f-2c9ce6f8ad25', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:06:19.211095 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-71ced1f1-478c-4de3-ba01-e2f7fc32f049 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e" status: 200 len: 344 microversion: 2.1 time: 0.693925 May 17 12:06:19.212588 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 1/2] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:06:18 2022] GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e => generated 344 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:20.224331 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6e586fb2-e328-4ce3-aa21-a212c39865b7 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db61e0280>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:20.365291 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6e586fb2-e328-4ce3-aa21-a212c39865b7 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e" status: 200 len: 345 microversion: 2.1 time: 0.143133 May 17 12:06:20.365291 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:06:20 2022] GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:06:20.381831 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-379b1473-060d-4e40-aa4d-b3b6aa37d166 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Action: 'create', calling method: .version_select at 0x7f2db61e08b0>, body: {"snapshot": {"volume_id": "a76e301e-fefe-4def-9a11-3abb9d48233e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-45788570"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:20.519544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:06:20.521520 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:06:20.522235 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:06:20.524284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:06:20.526523 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:06:20.573713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:20.574541 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:20.576318 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:20.576938 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:20.633006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Getting quotas for project 672159344e2c4ecbb0b633aa9606a119. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:06:20.650226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Getting quotas for user 2c48fb9b327045ed9236bea1ef6cdd73 and project 672159344e2c4ecbb0b633aa9606a119. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:06:20.695881 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:06:20.701079 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:06:20.825287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-379b1473-060d-4e40-aa4d-b3b6aa37d166 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.450083 May 17 12:06:20.831668 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 3/4] 10.222.0.58 () {60 vars in 1161 bytes} [Tue May 17 12:06:20 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:06:20.837864 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ad22b74f-882b-4da9-b5f6-a68a5d9b1a8d tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db61e04c0>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:20.963732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ad22b74f-882b-4da9-b5f6-a68a5d9b1a8d tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 200 len: 285 microversion: 2.1 time: 0.131354 May 17 12:06:20.964833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 4/5] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:06:20 2022] GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:20.975810 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-179167ad-f9d0-4dff-a31d-d65101402a44 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db616e160>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:21.012208 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-36cd0b4b-d705-495f-912d-9adff3c6d97d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252741 May 17 12:06:21.015191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 2/6] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:06:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:06:21.031130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6d2214c8-f12a-4ee6-a32d-660cdcb0cbba tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:21.035448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6d2214c8-f12a-4ee6-a32d-660cdcb0cbba tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:21.064254 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-179167ad-f9d0-4dff-a31d-d65101402a44 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.093003 May 17 12:06:21.065364 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 5/7] 10.222.0.58 () {58 vars in 1139 bytes} [Tue May 17 12:06:20 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:21.075884 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c930bd9b-9fe0-4864-bcd8-ca0b86ed2e2a tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db616ee50>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:21.149729 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c930bd9b-9fe0-4864-bcd8-ca0b86ed2e2a tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 200 len: 285 microversion: 2.1 time: 0.077585 May 17 12:06:21.151523 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 6/8] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:06:21 2022] GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 285 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:06:21.271681 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6d2214c8-f12a-4ee6-a32d-660cdcb0cbba tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:21.297737 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6d2214c8-f12a-4ee6-a32d-660cdcb0cbba tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1214 microversion: 2.1 time: 0.272271 May 17 12:06:21.309301 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 3/9] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:21 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1214 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:06:22.162547 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-36d9662d-cf69-465d-8357-bef02641d336 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db616eca0>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:22.230595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-36d9662d-cf69-465d-8357-bef02641d336 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 200 len: 285 microversion: 2.1 time: 0.071893 May 17 12:06:22.231563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 7/10] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:06:22 2022] GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 285 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:22.314938 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-cdd7bf98-e301-4d75-9bac-53b7b64c4379 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:22.315706 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-cdd7bf98-e301-4d75-9bac-53b7b64c4379 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:22.441354 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-cdd7bf98-e301-4d75-9bac-53b7b64c4379 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:22.448849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-cdd7bf98-e301-4d75-9bac-53b7b64c4379 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1214 microversion: 2.1 time: 0.137749 May 17 12:06:22.452158 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 4/11] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:22 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:23.248539 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-38fcab7e-da99-4925-9ec2-ef9eae8a8513 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db616e550>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:23.287580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-38fcab7e-da99-4925-9ec2-ef9eae8a8513 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 200 len: 285 microversion: 2.1 time: 0.046216 May 17 12:06:23.288651 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 8/12] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:06:23 2022] GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 285 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:23.472686 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5a9d0d8c-1987-42e8-a611-03653b686263 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:23.473312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5a9d0d8c-1987-42e8-a611-03653b686263 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:23.497816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d8c-1987-42e8-a611-03653b686263 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:23.507966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d8c-1987-42e8-a611-03653b686263 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:23.516706 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d8c-1987-42e8-a611-03653b686263 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:23.521856 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a9d0d8c-1987-42e8-a611-03653b686263 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:24.120837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5a9d0d8c-1987-42e8-a611-03653b686263 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:24.156514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5a9d0d8c-1987-42e8-a611-03653b686263 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1218 microversion: 2.1 time: 0.690449 May 17 12:06:24.170557 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 5/13] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:23 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1218 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:24.300809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-48532a10-d022-46e5-89fe-14aa0f83e4ca tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db61e0f70>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:24.396308 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-48532a10-d022-46e5-89fe-14aa0f83e4ca tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 200 len: 285 microversion: 2.1 time: 0.100473 May 17 12:06:24.397880 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 9/14] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:06:24 2022] GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:25.177125 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-02a507b5-d0d1-412f-a01f-39b71e70f2f8 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:25.178303 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-02a507b5-d0d1-412f-a01f-39b71e70f2f8 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:25.187930 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-02a507b5-d0d1-412f-a01f-39b71e70f2f8 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:25.188732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-02a507b5-d0d1-412f-a01f-39b71e70f2f8 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:25.203842 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-02a507b5-d0d1-412f-a01f-39b71e70f2f8 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:25.209326 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-02a507b5-d0d1-412f-a01f-39b71e70f2f8 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:25.310257 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-02a507b5-d0d1-412f-a01f-39b71e70f2f8 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:25.322357 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-02a507b5-d0d1-412f-a01f-39b71e70f2f8 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1218 microversion: 2.1 time: 0.150442 May 17 12:06:25.332564 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 6/15] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:25 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:25.409549 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2dd00c20-f40b-463f-99dd-b79a09e3feb5 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db61e0700>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:25.465354 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2dd00c20-f40b-463f-99dd-b79a09e3feb5 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 200 len: 285 microversion: 2.1 time: 0.059514 May 17 12:06:25.465931 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 10/16] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:06:25 2022] GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 285 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:26.339244 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0e5cbbab-c7df-4a12-b99d-57afbc6413e2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:26.340894 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0e5cbbab-c7df-4a12-b99d-57afbc6413e2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:26.357046 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0e5cbbab-c7df-4a12-b99d-57afbc6413e2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:26.364432 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0e5cbbab-c7df-4a12-b99d-57afbc6413e2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:26.371761 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0e5cbbab-c7df-4a12-b99d-57afbc6413e2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:26.372452 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0e5cbbab-c7df-4a12-b99d-57afbc6413e2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:26.477034 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-525982c4-9344-4aa1-824f-b12b57943566 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db61e0430>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:26.562053 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-525982c4-9344-4aa1-824f-b12b57943566 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 200 len: 285 microversion: 2.1 time: 0.089026 May 17 12:06:26.562761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 11/17] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:06:26 2022] GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:26.824066 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0e5cbbab-c7df-4a12-b99d-57afbc6413e2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:26.834991 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0e5cbbab-c7df-4a12-b99d-57afbc6413e2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1218 microversion: 2.1 time: 0.499690 May 17 12:06:26.835596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 7/18] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:26 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1218 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:27.575679 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1cd8ebc4-d253-4880-8a8f-7aa8096458b7 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db6285550>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:27.652389 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1cd8ebc4-d253-4880-8a8f-7aa8096458b7 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 200 len: 286 microversion: 2.1 time: 0.082012 May 17 12:06:27.652962 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 12/19] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:06:27 2022] GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:27.663508 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ba8d31fb-414e-4c79-9b69-b8b14ca9a220 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db4fc1040>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:27.782363 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ba8d31fb-414e-4c79-9b69-b8b14ca9a220 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 202 len: 0 microversion: 2.1 time: 0.122778 May 17 12:06:27.783174 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 8/20] 10.222.0.58 () {58 vars in 1253 bytes} [Tue May 17 12:06:27 2022] DELETE /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:06:27.792425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7a1beef4-815e-4db2-a6b9-c310e1c0c76b tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db616e670>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:27.842015 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7a1beef4-815e-4db2-a6b9-c310e1c0c76b tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 200 len: 285 microversion: 2.1 time: 0.054531 May 17 12:06:27.843064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 13/21] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:06:27 2022] GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 285 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:27.853997 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-13f712c3-dcbc-4843-98aa-ac6bbb111c20 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:27.854858 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-13f712c3-dcbc-4843-98aa-ac6bbb111c20 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:27.865494 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-13f712c3-dcbc-4843-98aa-ac6bbb111c20 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:27.874006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-13f712c3-dcbc-4843-98aa-ac6bbb111c20 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:27.875227 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-13f712c3-dcbc-4843-98aa-ac6bbb111c20 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:27.875836 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-13f712c3-dcbc-4843-98aa-ac6bbb111c20 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:28.824991 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-13f712c3-dcbc-4843-98aa-ac6bbb111c20 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:28.840100 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-13f712c3-dcbc-4843-98aa-ac6bbb111c20 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1284 microversion: 2.1 time: 0.991241 May 17 12:06:28.842055 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 9/22] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:27 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1284 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:28.856485 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-481beb05-7afe-45b8-bfc5-1ec7e551cd93 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db616ec10>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:28.894580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-481beb05-7afe-45b8-bfc5-1ec7e551cd93 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] HTTP exception thrown: Snapshot 4e51fa27-a9de-4a4c-a79f-69ae165d8e29 could not be found. May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-481beb05-7afe-45b8-bfc5-1ec7e551cd93 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Request method failure captured: May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 HTTP/1.1 May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4-4W18dc6rQcpQt021N5FqgGvJYKsOGveio-nKfRvICs1vJlDAbUKs2nsgsSRTdG_YsZ1pAvTMyPPl0W1Y3xxWUKdb7EIc06qohDkB7AqDOONtnEKka348VGqrEMh4Klfp9g6PrQJQwzn762fcIudLd5EugRa09_lNggdEAIS0lz7k May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: b24cd1a360fe4f798dc75cdcdc79ab4b May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:06:28.899317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b24cd1a360fe4f798dc75cdcdc79ab4b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}] May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: b24cd1a360fe4f798dc75cdcdc79ab4b May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-VolumesSnapshotsTestJSON-368478200-project May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: ca5437b5c23049a9b9d116f84665c9e2 May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-VolumesSnapshotsTestJSON-368478200-project May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Snapshot 4e51fa27-a9de-4a4c-a79f-69ae165d8e29 could not be found. May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '4e51fa27-a9de-4a4c-a79f-69ae165d8e29'} May 17 12:06:28.901700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4e51fa27-a9de-4a4c-a79f-69ae165d8e29 could not be found. (HTTP 404) (Request-ID: req-7af62be2-ded3-4430-9300-7a396bb3e7dd) May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:28.902463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 12:06:28.903340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4e51fa27-a9de-4a4c-a79f-69ae165d8e29 could not be found. May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 17 12:06:28.905623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4e51fa27-a9de-4a4c-a79f-69ae165d8e29 could not be found. May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4e51fa27-a9de-4a4c-a79f-69ae165d8e29 could not be found. May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-481beb05-7afe-45b8-bfc5-1ec7e551cd93 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Returning 404 to user: Snapshot 4e51fa27-a9de-4a4c-a79f-69ae165d8e29 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-481beb05-7afe-45b8-bfc5-1ec7e551cd93 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29" status: 404 len: 111 microversion: 2.1 time: 0.054300 May 17 12:06:28.909006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 14/23] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:06:28 2022] GET /compute/v2.1/os-snapshots/4e51fa27-a9de-4a4c-a79f-69ae165d8e29 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:06:28.915303 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-af16c30a-b997-4b40-96db-bb0dfdd53b0b tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db4fb28b0>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:29.110845 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-af16c30a-b997-4b40-96db-bb0dfdd53b0b tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e" status: 202 len: 0 microversion: 2.1 time: 0.199756 May 17 12:06:29.111607 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 10/24] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 17 12:06:28 2022] DELETE /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:06:29.122849 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3016b529-317f-4eb8-bd8b-d569118b7099 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db615d160>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:29.282717 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3016b529-317f-4eb8-bd8b-d569118b7099 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e" status: 200 len: 344 microversion: 2.1 time: 0.166377 May 17 12:06:29.283698 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 15/25] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:06:29 2022] GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e => generated 344 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:06:29.727170 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-67c956c3-3825-4332-b6e4-4fede51ccf61 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Action: 'create', calling method: .version_select at 0x7f2db5023ca0>, body: {"keypair": {"name": "tempest-keypair-2031613506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlszMFoj/xxPJtRnYsPd5VVtko8gi3dEAffcktzRciJSsDgWxX76IQSY0w7hc10Ns3JipNioOw9/42GEb0b8OlJND4VArUuvwyLQm6kbaOYj9DAFvJgb6hAObz3419C+A=="}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:29.825534 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-67c956c3-3825-4332-b6e4-4fede51ccf61 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Getting quotas for project cd2c9994923540748c1513406e3e7ffc. Resources: {'key_pairs'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:06:29.847162 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-67c956c3-3825-4332-b6e4-4fede51ccf61 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Getting quotas for user e8a6a76a94ca4fb197c7b1705b809c54 and project cd2c9994923540748c1513406e3e7ffc. Resources: {'key_pairs'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:06:29.859326 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-60909577-5f71-41eb-98b9-bb7a64c73046 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:29.861128 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-60909577-5f71-41eb-98b9-bb7a64c73046 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:29.926280 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-60909577-5f71-41eb-98b9-bb7a64c73046 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:29.935220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-60909577-5f71-41eb-98b9-bb7a64c73046 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:29.948460 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-60909577-5f71-41eb-98b9-bb7a64c73046 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:29.950155 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-60909577-5f71-41eb-98b9-bb7a64c73046 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:30.001169 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-67c956c3-3825-4332-b6e4-4fede51ccf61 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.617564 May 17 12:06:30.003925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 11/26] 10.222.0.58 () {62 vars in 1199 bytes} [Tue May 17 12:06:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 624 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 12:06:30.297789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b9761b03-d894-494e-b7ec-f83a1bc15bad tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db4f95700>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:30.405892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-b9761b03-d894-494e-b7ec-f83a1bc15bad tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] HTTP exception thrown: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b9761b03-d894-494e-b7ec-f83a1bc15bad tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Request method failure captured: May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e HTTP/1.1 May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4-4W18dc6rQcpQt021N5FqgGvJYKsOGveio-nKfRvICs1vJlDAbUKs2nsgsSRTdG_YsZ1pAvTMyPPl0W1Y3xxWUKdb7EIc06qohDkB7AqDOONtnEKka348VGqrEMh4Klfp9g6PrQJQwzn762fcIudLd5EugRa09_lNggdEAIS0lz7k May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: b24cd1a360fe4f798dc75cdcdc79ab4b May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:06:30.416446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b24cd1a360fe4f798dc75cdcdc79ab4b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}] May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: b24cd1a360fe4f798dc75cdcdc79ab4b May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-VolumesSnapshotsTestJSON-368478200-project May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: ca5437b5c23049a9b9d116f84665c9e2 May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-VolumesSnapshotsTestJSON-368478200-project May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'a76e301e-fefe-4def-9a11-3abb9d48233e'} May 17 12:06:30.417544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. (HTTP 404) (Request-ID: req-8affd4b6-4867-4f54-bc9e-e29b0750d356) May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:30.418166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 12:06:30.419064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 12:06:30.421240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b9761b03-d894-494e-b7ec-f83a1bc15bad tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Returning 404 to user: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b9761b03-d894-494e-b7ec-f83a1bc15bad tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e" status: 404 len: 109 microversion: 2.1 time: 0.121068 May 17 12:06:30.423315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 12/27] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:06:30 2022] GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 12:06:30.423976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-60909577-5f71-41eb-98b9-bb7a64c73046 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:30.450546 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8cf0e689-8af3-4ab7-9445-d4d584683ded tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db6b46a60>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:30.454507 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-60909577-5f71-41eb-98b9-bb7a64c73046 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1272 microversion: 2.1 time: 0.595436 May 17 12:06:30.455372 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 16/28] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:29 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1272 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:30.509452 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-8cf0e689-8af3-4ab7-9445-d4d584683ded tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] HTTP exception thrown: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8cf0e689-8af3-4ab7-9445-d4d584683ded tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Request method failure captured: May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: DELETE /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e HTTP/1.1 May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4-4W18dc6rQcpQt021N5FqgGvJYKsOGveio-nKfRvICs1vJlDAbUKs2nsgsSRTdG_YsZ1pAvTMyPPl0W1Y3xxWUKdb7EIc06qohDkB7AqDOONtnEKka348VGqrEMh4Klfp9g6PrQJQwzn762fcIudLd5EugRa09_lNggdEAIS0lz7k May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: b24cd1a360fe4f798dc75cdcdc79ab4b May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:06:30.511850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b24cd1a360fe4f798dc75cdcdc79ab4b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}] May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: b24cd1a360fe4f798dc75cdcdc79ab4b May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-VolumesSnapshotsTestJSON-368478200-project May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: ca5437b5c23049a9b9d116f84665c9e2 May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-VolumesSnapshotsTestJSON-368478200-project May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'a76e301e-fefe-4def-9a11-3abb9d48233e'} May 17 12:06:30.512975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. (HTTP 404) (Request-ID: req-3de4156b-5772-4fe7-a547-28a75497a810) May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:30.513731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 12:06:30.514816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 12:06:30.516123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.517370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:06:30.525081 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8cf0e689-8af3-4ab7-9445-d4d584683ded tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Returning 404 to user: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:06:30.526194 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8cf0e689-8af3-4ab7-9445-d4d584683ded tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e" status: 404 len: 109 microversion: 2.1 time: 0.098851 May 17 12:06:30.532290 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 13/29] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 17 12:06:30 2022] DELETE /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:06:30.536039 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fa30f3f4-d7da-45e6-999f-d62765f444d6 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Calling method '.version_select at 0x7f2db60790d0>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:30.608903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-fa30f3f4-d7da-45e6-999f-d62765f444d6 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] HTTP exception thrown: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fa30f3f4-d7da-45e6-999f-d62765f444d6 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Request method failure captured: May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e HTTP/1.1 May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4-4W18dc6rQcpQt021N5FqgGvJYKsOGveio-nKfRvICs1vJlDAbUKs2nsgsSRTdG_YsZ1pAvTMyPPl0W1Y3xxWUKdb7EIc06qohDkB7AqDOONtnEKka348VGqrEMh4Klfp9g6PrQJQwzn762fcIudLd5EugRa09_lNggdEAIS0lz7k May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: b24cd1a360fe4f798dc75cdcdc79ab4b May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:06:30.614207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b24cd1a360fe4f798dc75cdcdc79ab4b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b24cd1a360fe4f798dc75cdcdc79ab4b"}]}] May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: b24cd1a360fe4f798dc75cdcdc79ab4b May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-368478200 May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-VolumesSnapshotsTestJSON-368478200-project May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: ca5437b5c23049a9b9d116f84665c9e2 May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-VolumesSnapshotsTestJSON-368478200-project May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'a76e301e-fefe-4def-9a11-3abb9d48233e'} May 17 12:06:30.615365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. (HTTP 404) (Request-ID: req-27e534ef-93fd-409f-bf98-ccd455269d92) May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:30.616011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 12:06:30.617035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 12:06:30.618551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. May 17 12:06:30.619594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:06:30.623539 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fa30f3f4-d7da-45e6-999f-d62765f444d6 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] Returning 404 to user: Volume a76e301e-fefe-4def-9a11-3abb9d48233e could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:06:30.623539 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fa30f3f4-d7da-45e6-999f-d62765f444d6 tempest-VolumesSnapshotsTestJSON-368478200 tempest-VolumesSnapshotsTestJSON-368478200-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e" status: 404 len: 109 microversion: 2.1 time: 0.090811 May 17 12:06:30.623539 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 17/30] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:06:30 2022] GET /compute/v2.1/os-volumes/a76e301e-fefe-4def-9a11-3abb9d48233e => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 12:06:31.485453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7afed614-e7ef-407f-b4eb-927961c399c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:31.488397 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7afed614-e7ef-407f-b4eb-927961c399c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:31.528719 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7afed614-e7ef-407f-b4eb-927961c399c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:31.535325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7afed614-e7ef-407f-b4eb-927961c399c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:31.540229 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7afed614-e7ef-407f-b4eb-927961c399c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:31.543937 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7afed614-e7ef-407f-b4eb-927961c399c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:32.075268 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7afed614-e7ef-407f-b4eb-927961c399c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:32.102781 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7afed614-e7ef-407f-b4eb-927961c399c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1272 microversion: 2.1 time: 0.623764 May 17 12:06:32.104066 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 14/31] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:31 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1272 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:33.120825 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f6dd7239-209e-414d-b530-3e28e62c4757 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:33.121480 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f6dd7239-209e-414d-b530-3e28e62c4757 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:33.137957 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f6dd7239-209e-414d-b530-3e28e62c4757 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:33.138658 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f6dd7239-209e-414d-b530-3e28e62c4757 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:33.146835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f6dd7239-209e-414d-b530-3e28e62c4757 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:33.147402 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f6dd7239-209e-414d-b530-3e28e62c4757 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:33.878422 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-08fd52f2-a10a-4faf-a24e-d5e9b64fa5be tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'create', calling method: .version_select at 0x7f2db61e0670>, body: {"keypair": {"name": "tempest-keypair-445600030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCff6/pw4Qu+rYj3q1HxEpFyBH36aqdoJERjEgK6o3UZIhKs7uVlxnco/Rj/qqCQhqlnmVztf2z5amlXXdb54JT+OkG7A+p/dPgA7bfSyt8MqktwE6Mg8ANiwhJYHoq8jg=="}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:34.039527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-08fd52f2-a10a-4faf-a24e-d5e9b64fa5be tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Getting quotas for project 2ae797920785457f975f9f85d80849af. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:06:34.061141 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-08fd52f2-a10a-4faf-a24e-d5e9b64fa5be tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Getting quotas for user 79ff688720854ad1b62b3c9b51546e0f and project 2ae797920785457f975f9f85d80849af. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:06:34.339234 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-08fd52f2-a10a-4faf-a24e-d5e9b64fa5be tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.284635 May 17 12:06:34.347811 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 18/32] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 17 12:06:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:34.816611 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f6dd7239-209e-414d-b530-3e28e62c4757 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:34.829703 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f6dd7239-209e-414d-b530-3e28e62c4757 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 1.713343 May 17 12:06:34.831500 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 15/33] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:33 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:35.856745 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c13feb8b-f764-4531-8133-49719f818e46 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:35.857448 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c13feb8b-f764-4531-8133-49719f818e46 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:35.871690 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c13feb8b-f764-4531-8133-49719f818e46 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:35.873502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c13feb8b-f764-4531-8133-49719f818e46 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:35.876144 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c13feb8b-f764-4531-8133-49719f818e46 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:35.876715 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c13feb8b-f764-4531-8133-49719f818e46 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:37.693213 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c13feb8b-f764-4531-8133-49719f818e46 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:37.732707 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c13feb8b-f764-4531-8133-49719f818e46 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 1.883690 May 17 12:06:37.737933 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 19/34] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:35 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:38.758063 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-86b7e7a3-133e-4abc-89ad-8134c481bc04 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:38.760540 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-86b7e7a3-133e-4abc-89ad-8134c481bc04 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:38.783971 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-86b7e7a3-133e-4abc-89ad-8134c481bc04 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:38.824545 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-86b7e7a3-133e-4abc-89ad-8134c481bc04 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:38.831454 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-86b7e7a3-133e-4abc-89ad-8134c481bc04 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:38.831987 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-86b7e7a3-133e-4abc-89ad-8134c481bc04 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:40.303172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-86b7e7a3-133e-4abc-89ad-8134c481bc04 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:40.311290 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-86b7e7a3-133e-4abc-89ad-8134c481bc04 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 1.559833 May 17 12:06:40.311884 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 16/35] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:38 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:40.445060 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-6aee7c71-0bc1-45bb-8282-7e5ce3a8de3f req-0b6883ec-68f8-4bd9-8483-9eb8536960bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "120ebbd5-b659-4429-aae8-830d4b1f06d1", "tag": "2d56cb05-0c73-4387-b334-1a1670e55477"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:40.499457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-6aee7c71-0bc1-45bb-8282-7e5ce3a8de3f req-0b6883ec-68f8-4bd9-8483-9eb8536960bc service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:40.501758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-6aee7c71-0bc1-45bb-8282-7e5ce3a8de3f req-0b6883ec-68f8-4bd9-8483-9eb8536960bc service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:40.616173 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-6aee7c71-0bc1-45bb-8282-7e5ce3a8de3f req-0b6883ec-68f8-4bd9-8483-9eb8536960bc service nova] Creating event network-changed:2d56cb05-0c73-4387-b334-1a1670e55477 for instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 on hv-cinder-83769 May 17 12:06:40.618839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-6aee7c71-0bc1-45bb-8282-7e5ce3a8de3f req-0b6883ec-68f8-4bd9-8483-9eb8536960bc service nova] Acquired lock "compute-rpcapi-router" {{(pid=117114) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 12:06:40.622565 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-401fba8f-c149-4e1f-bf13-0763882cb25e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:40.625393 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-401fba8f-c149-4e1f-bf13-0763882cb25e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:40.628137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-401fba8f-c149-4e1f-bf13-0763882cb25e None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:40.628826 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-401fba8f-c149-4e1f-bf13-0763882cb25e None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:40.668631 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.compute.rpcapi [None req-401fba8f-c149-4e1f-bf13-0763882cb25e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 12:06:40.670624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-401fba8f-c149-4e1f-bf13-0763882cb25e None None] Releasing lock "compute-rpcapi-router" {{(pid=117114) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 12:06:40.744265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-401fba8f-c149-4e1f-bf13-0763882cb25e None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.037631 May 17 12:06:40.746279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 20/36] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:06:41.331805 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d4508f2a-2330-43a2-b5c3-317249b2f1fa tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:41.333312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d4508f2a-2330-43a2-b5c3-317249b2f1fa tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:41.352995 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d4508f2a-2330-43a2-b5c3-317249b2f1fa tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:41.353727 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d4508f2a-2330-43a2-b5c3-317249b2f1fa tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:41.355177 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d4508f2a-2330-43a2-b5c3-317249b2f1fa tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:41.359198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d4508f2a-2330-43a2-b5c3-317249b2f1fa tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:42.190715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d4508f2a-2330-43a2-b5c3-317249b2f1fa tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:42.200605 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d4508f2a-2330-43a2-b5c3-317249b2f1fa tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 0.874093 May 17 12:06:42.209312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 17/37] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:41 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:42.277474 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-647660662", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c8419b7-b572-4795-bcd2-a5f8cfb8c6c0"}], "security_groups": [{"name": "tempest-securitygroup--1796974705"}], "key_name": "tempest-keypair-2031613506", "user_data": "}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:42.941479 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1048551996", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:42.952381 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] validate_networks() for [('5c8419b7-b572-4795-bcd2-a5f8cfb8c6c0', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:06:43.193533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.network.neutron [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] validate_networks() for [('6d0c04f0-74ef-4155-bac9-58f2b397860c', None, None, None, None, None)] {{(pid=117114) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:06:45.126966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:06:45.128060 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:06:45.128757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:06:45.129337 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:06:45.130182 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:06:45.142138 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:45.142970 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:45.144160 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:45.144781 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:45.178839 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Getting quotas for project cd2c9994923540748c1513406e3e7ffc. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:06:45.198525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Getting quotas for user e8a6a76a94ca4fb197c7b1705b809c54 and project cd2c9994923540748c1513406e3e7ffc. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:06:45.229892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:06:45.232747 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:06:45.374982 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e884976e-edfc-4872-867d-901ef976266a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.105734 May 17 12:06:45.375656 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 18/38] 10.222.0.58 () {62 vars in 1187 bytes} [Tue May 17 12:06:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 3108 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 17 12:06:45.388608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ef137959-336f-489c-9662-51d2afcc3ca6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:45.396605 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ef137959-336f-489c-9662-51d2afcc3ca6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:45.423826 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ef137959-336f-489c-9662-51d2afcc3ca6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:45.424314 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ef137959-336f-489c-9662-51d2afcc3ca6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:45.430425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ef137959-336f-489c-9662-51d2afcc3ca6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:45.431078 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ef137959-336f-489c-9662-51d2afcc3ca6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:45.904902 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ef137959-336f-489c-9662-51d2afcc3ca6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:45.914665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ef137959-336f-489c-9662-51d2afcc3ca6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 0.534565 May 17 12:06:45.928867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 19/39] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:45 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:46.378661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Flavor limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:06:46.379737 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Image limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:06:46.380429 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Flavor pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:06:46.381028 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Image pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:06:46.382246 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:06:46.412232 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:46.416297 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:46.420166 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:46.422601 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:46.436323 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-97d67a0b-9c49-4720-8e02-30cf7e8c2f47 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: .version_select at 0x7f2db4f95310>, body: {"keypair": {"name": "tempest-keypair-1113558038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3AVNpu/DetQMDEqU1OM9U/Ne0Q7i79OWiBHsAZAhCRpRaj/LNH2aMP8MhTgOAI8p+x0iQksVjLYQ7OtzqCTdVvh82HUZuQYhEKmLx9D4jxqNYthRbMd06eCF7Yo0syeQ=="}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:46.482330 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Getting quotas for project 748d013ae6664fc79a9ac23e58f642e5. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:06:46.483715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-97d67a0b-9c49-4720-8e02-30cf7e8c2f47 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for project 27acd98621cd4a51ac46fb12e1824168. Resources: {'key_pairs'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:06:46.488038 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-97d67a0b-9c49-4720-8e02-30cf7e8c2f47 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for user 586e15d5d16543e6b70c87fbf9079e9e and project 27acd98621cd4a51ac46fb12e1824168. Resources: {'key_pairs'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:06:46.502080 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Getting quotas for user bb9da9200f804a4a987f2cdb49f6801d and project 748d013ae6664fc79a9ac23e58f642e5. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:06:46.526855 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-97d67a0b-9c49-4720-8e02-30cf7e8c2f47 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.596345 May 17 12:06:46.537692 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 20/40] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 17 12:06:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:46.544282 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-15de0076-ed48-41d9-b6c8-6a700ffbb8cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:46.549596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-15de0076-ed48-41d9-b6c8-6a700ffbb8cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:46.564373 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Going to run 1 instances... {{(pid=117114) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:06:46.568263 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:06:46.696724 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-15de0076-ed48-41d9-b6c8-6a700ffbb8cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:46.709491 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-15de0076-ed48-41d9-b6c8-6a700ffbb8cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:46.711082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-15de0076-ed48-41d9-b6c8-6a700ffbb8cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:46.713226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-15de0076-ed48-41d9-b6c8-6a700ffbb8cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1281 microversion: 2.20 time: 0.174202 May 17 12:06:46.725727 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 21/41] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:06:46 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1281 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:06:46.727735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d93651b8-dcbc-4d28-a22c-481bbb0c72de tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.499781 May 17 12:06:46.730951 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 21/42] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:06:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 4505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:06:46.741883 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-967119603", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94b88bbc-a9e8-40ae-bcc3-9f4064606643"}], "security_groups": [{"name": "tempest-securitygroup--1964851619"}], "key_name": "tempest-keypair-445600030", "user_data": "}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:46.757052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1e72a870-3588-47b1-99fa-4fa526eef822 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:46.760526 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1e72a870-3588-47b1-99fa-4fa526eef822 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:46.877054 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1e72a870-3588-47b1-99fa-4fa526eef822 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:46.911783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1e72a870-3588-47b1-99fa-4fa526eef822 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1222 microversion: 2.1 time: 0.176467 May 17 12:06:46.913062 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 22/43] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:46 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1222 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:46.935339 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b9ba5c29-fc2e-46fd-a3f4-25d90ece0d26 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:46.938220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b9ba5c29-fc2e-46fd-a3f4-25d90ece0d26 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:46.972233 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b9ba5c29-fc2e-46fd-a3f4-25d90ece0d26 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:46.986480 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b9ba5c29-fc2e-46fd-a3f4-25d90ece0d26 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:46.987620 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b9ba5c29-fc2e-46fd-a3f4-25d90ece0d26 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:46.995568 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b9ba5c29-fc2e-46fd-a3f4-25d90ece0d26 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:47.140825 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] validate_networks() for [('94b88bbc-a9e8-40ae-bcc3-9f4064606643', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:06:47.675026 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b9ba5c29-fc2e-46fd-a3f4-25d90ece0d26 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:47.689056 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b9ba5c29-fc2e-46fd-a3f4-25d90ece0d26 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 0.757409 May 17 12:06:47.700420 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 23/44] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:46 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:47.707160 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1072475268", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:47.839725 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.network.neutron [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] validate_networks() for [('6d0c04f0-74ef-4155-bac9-58f2b397860c', None, None, None, None, None)] {{(pid=117114) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:06:48.234016 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:06:48.239325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:06:48.239325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:06:48.239325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:06:48.239325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:06:48.263372 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:48.264008 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:48.269342 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:48.270578 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:48.294625 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Getting quotas for project 2ae797920785457f975f9f85d80849af. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:06:48.300576 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Getting quotas for user 79ff688720854ad1b62b3c9b51546e0f and project 2ae797920785457f975f9f85d80849af. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:06:48.339670 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:06:48.346456 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:06:48.469496 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7763b06c-db58-42f9-9837-a6ea9e9fbaab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.742055 May 17 12:06:48.470424 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:06:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:06:48.482590 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b0de2771-9ca1-4361-9524-b22d2ccd5acf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:48.483790 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b0de2771-9ca1-4361-9524-b22d2ccd5acf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:48.492959 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0de2771-9ca1-4361-9524-b22d2ccd5acf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:48.493822 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0de2771-9ca1-4361-9524-b22d2ccd5acf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:48.494911 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0de2771-9ca1-4361-9524-b22d2ccd5acf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:48.495498 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0de2771-9ca1-4361-9524-b22d2ccd5acf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:48.689424 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b0de2771-9ca1-4361-9524-b22d2ccd5acf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:48.700355 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b0de2771-9ca1-4361-9524-b22d2ccd5acf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:48.712865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b0de2771-9ca1-4361-9524-b22d2ccd5acf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:48.718177 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b0de2771-9ca1-4361-9524-b22d2ccd5acf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1285 microversion: 2.20 time: 0.239855 May 17 12:06:48.735059 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:06:48 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:06:48.746474 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-43ade379-c1dc-46a7-a9ab-38dc6b049258 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:48.749433 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-43ade379-c1dc-46a7-a9ab-38dc6b049258 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:48.900651 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-43ade379-c1dc-46a7-a9ab-38dc6b049258 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:48.908024 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-43ade379-c1dc-46a7-a9ab-38dc6b049258 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1236 microversion: 2.1 time: 0.170496 May 17 12:06:48.908659 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 24/47] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:48 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1236 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:48.924807 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-49d9c533-fa8c-4d58-baf7-271b9070a607 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:48.925675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-49d9c533-fa8c-4d58-baf7-271b9070a607 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:48.933621 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-49d9c533-fa8c-4d58-baf7-271b9070a607 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:48.934301 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-49d9c533-fa8c-4d58-baf7-271b9070a607 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:48.936228 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-49d9c533-fa8c-4d58-baf7-271b9070a607 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:48.938155 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-49d9c533-fa8c-4d58-baf7-271b9070a607 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:49.233865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-49d9c533-fa8c-4d58-baf7-271b9070a607 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:49.250566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-49d9c533-fa8c-4d58-baf7-271b9070a607 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 0.329744 May 17 12:06:49.252013 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 25/48] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:48 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:49.741009 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a886130d-4aee-4153-9971-f777b4d96432 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:49.741673 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a886130d-4aee-4153-9971-f777b4d96432 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:49.762298 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a886130d-4aee-4153-9971-f777b4d96432 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:49.766541 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a886130d-4aee-4153-9971-f777b4d96432 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:49.767909 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a886130d-4aee-4153-9971-f777b4d96432 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:49.770305 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a886130d-4aee-4153-9971-f777b4d96432 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:49.918959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Flavor limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:06:49.919405 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Image limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:06:49.919858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Flavor pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:06:49.923678 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Image pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:06:49.924554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:06:49.927172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a886130d-4aee-4153-9971-f777b4d96432 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:49.940575 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:49.941293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a886130d-4aee-4153-9971-f777b4d96432 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:49.943012 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:49.943226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a886130d-4aee-4153-9971-f777b4d96432 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:49.944636 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:49.944753 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a886130d-4aee-4153-9971-f777b4d96432 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1333 microversion: 2.20 time: 0.207789 May 17 12:06:49.945252 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 26/49] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:06:49 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1333 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:06:49.948455 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:49.990318 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-08ffd6ee-4e2c-4d34-ad27-b4a1b65affea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:49.990953 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-08ffd6ee-4e2c-4d34-ad27-b4a1b65affea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:49.991431 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Getting quotas for project 748d013ae6664fc79a9ac23e58f642e5. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:06:49.999772 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Getting quotas for user bb9da9200f804a4a987f2cdb49f6801d and project 748d013ae6664fc79a9ac23e58f642e5. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:06:50.006721 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08ffd6ee-4e2c-4d34-ad27-b4a1b65affea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:50.007173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08ffd6ee-4e2c-4d34-ad27-b4a1b65affea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:50.007966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08ffd6ee-4e2c-4d34-ad27-b4a1b65affea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:50.009283 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08ffd6ee-4e2c-4d34-ad27-b4a1b65affea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:50.030536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Going to run 1 instances... {{(pid=117114) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:06:50.035861 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:06:50.112484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-08ffd6ee-4e2c-4d34-ad27-b4a1b65affea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:50.122083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-08ffd6ee-4e2c-4d34-ad27-b4a1b65affea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1288 microversion: 2.1 time: 0.150970 May 17 12:06:50.137032 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 27/50] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:49 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1288 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:50.149933 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bf6e49b7-3a70-4c00-b1f8-549e827bdd29 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.447835 May 17 12:06:50.151513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 24/51] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:06:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:06:50.161232 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1e5118a4-75f5-4521-b743-01ee20d2e329 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:50.162062 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1e5118a4-75f5-4521-b743-01ee20d2e329 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:50.255838 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1e5118a4-75f5-4521-b743-01ee20d2e329 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:50.268932 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6b01be03-5317-4c4b-97fc-c3469493198d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:50.269715 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6b01be03-5317-4c4b-97fc-c3469493198d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:50.276522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1e5118a4-75f5-4521-b743-01ee20d2e329 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1222 microversion: 2.1 time: 0.106230 May 17 12:06:50.286090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 28/52] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:50 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:50.286284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b01be03-5317-4c4b-97fc-c3469493198d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:50.286284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b01be03-5317-4c4b-97fc-c3469493198d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:50.286284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b01be03-5317-4c4b-97fc-c3469493198d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:50.286284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b01be03-5317-4c4b-97fc-c3469493198d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:50.963375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6f3c5368-78db-487a-8010-5adb195fc28f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:50.964244 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6f3c5368-78db-487a-8010-5adb195fc28f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:50.973871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6f3c5368-78db-487a-8010-5adb195fc28f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:50.976752 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6f3c5368-78db-487a-8010-5adb195fc28f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:50.979567 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6f3c5368-78db-487a-8010-5adb195fc28f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:50.983421 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6f3c5368-78db-487a-8010-5adb195fc28f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:51.352469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6f3c5368-78db-487a-8010-5adb195fc28f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:51.362413 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6f3c5368-78db-487a-8010-5adb195fc28f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:51.376336 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6f3c5368-78db-487a-8010-5adb195fc28f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:51.377774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6f3c5368-78db-487a-8010-5adb195fc28f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1339 microversion: 2.20 time: 0.418837 May 17 12:06:51.390348 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 29/53] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:06:50 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1339 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:06:51.405081 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6f518a99-88a1-4be6-849a-3ce7c3916206 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:51.410934 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6f518a99-88a1-4be6-849a-3ce7c3916206 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:51.417551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6b01be03-5317-4c4b-97fc-c3469493198d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:51.431717 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6b01be03-5317-4c4b-97fc-c3469493198d tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 1.164033 May 17 12:06:51.436772 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6f518a99-88a1-4be6-849a-3ce7c3916206 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:51.437236 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6f518a99-88a1-4be6-849a-3ce7c3916206 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:51.438156 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 25/54] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:50 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:06:51.445351 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6f518a99-88a1-4be6-849a-3ce7c3916206 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:51.445351 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6f518a99-88a1-4be6-849a-3ce7c3916206 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:51.456080 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a14777e6-6d3b-4d1e-b87d-9a62942aad1f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:51.458980 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a14777e6-6d3b-4d1e-b87d-9a62942aad1f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:51.468262 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a14777e6-6d3b-4d1e-b87d-9a62942aad1f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:51.469632 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a14777e6-6d3b-4d1e-b87d-9a62942aad1f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:51.470654 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a14777e6-6d3b-4d1e-b87d-9a62942aad1f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:51.471241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a14777e6-6d3b-4d1e-b87d-9a62942aad1f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:51.644048 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a14777e6-6d3b-4d1e-b87d-9a62942aad1f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:51.655489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a14777e6-6d3b-4d1e-b87d-9a62942aad1f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1274 microversion: 2.1 time: 0.215019 May 17 12:06:51.658954 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 26/55] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:51 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1274 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:51.690850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6f518a99-88a1-4be6-849a-3ce7c3916206 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:51.717472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6f518a99-88a1-4be6-849a-3ce7c3916206 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1296 microversion: 2.1 time: 0.325299 May 17 12:06:51.719548 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 30/56] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:51 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1296 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:52.397350 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-62b42d8e-e46b-42cf-8234-e59da227a68d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:52.398099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-62b42d8e-e46b-42cf-8234-e59da227a68d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:52.411758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62b42d8e-e46b-42cf-8234-e59da227a68d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:52.412367 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62b42d8e-e46b-42cf-8234-e59da227a68d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:52.413253 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62b42d8e-e46b-42cf-8234-e59da227a68d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:52.413788 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62b42d8e-e46b-42cf-8234-e59da227a68d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:52.460619 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-40d690d0-6344-404f-87a2-42251c6d4e6f tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:52.461765 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-40d690d0-6344-404f-87a2-42251c6d4e6f tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:52.479704 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-40d690d0-6344-404f-87a2-42251c6d4e6f tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:52.480274 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-40d690d0-6344-404f-87a2-42251c6d4e6f tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:52.481321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-40d690d0-6344-404f-87a2-42251c6d4e6f tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:52.482673 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-40d690d0-6344-404f-87a2-42251c6d4e6f tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:52.666827 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-62b42d8e-e46b-42cf-8234-e59da227a68d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:52.680980 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-62b42d8e-e46b-42cf-8234-e59da227a68d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:52.685396 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-62b42d8e-e46b-42cf-8234-e59da227a68d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:52.694775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-62b42d8e-e46b-42cf-8234-e59da227a68d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1339 microversion: 2.20 time: 0.299619 May 17 12:06:52.696537 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 27/57] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:06:52 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1339 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:06:52.701569 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a89fc7e6-15b3-47d7-b760-21c80c9f848f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:52.711033 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a89fc7e6-15b3-47d7-b760-21c80c9f848f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:52.728294 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a89fc7e6-15b3-47d7-b760-21c80c9f848f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:52.728893 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a89fc7e6-15b3-47d7-b760-21c80c9f848f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:52.729733 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a89fc7e6-15b3-47d7-b760-21c80c9f848f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:52.730184 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a89fc7e6-15b3-47d7-b760-21c80c9f848f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:52.888549 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-40d690d0-6344-404f-87a2-42251c6d4e6f tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:52.895858 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-40d690d0-6344-404f-87a2-42251c6d4e6f tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 0.440909 May 17 12:06:52.896470 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 31/58] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:52 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:06:52.905391 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-564a46c2-00cd-4e06-8fbf-dcd0e50634df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:52.917073 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-564a46c2-00cd-4e06-8fbf-dcd0e50634df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:52.923242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-564a46c2-00cd-4e06-8fbf-dcd0e50634df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:52.923878 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-564a46c2-00cd-4e06-8fbf-dcd0e50634df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:52.924839 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-564a46c2-00cd-4e06-8fbf-dcd0e50634df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:52.925428 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-564a46c2-00cd-4e06-8fbf-dcd0e50634df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:53.049922 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-564a46c2-00cd-4e06-8fbf-dcd0e50634df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:53.057978 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-564a46c2-00cd-4e06-8fbf-dcd0e50634df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1294 microversion: 2.1 time: 0.156591 May 17 12:06:53.062296 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 32/59] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:52 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1294 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:53.144996 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a89fc7e6-15b3-47d7-b760-21c80c9f848f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:53.154225 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a89fc7e6-15b3-47d7-b760-21c80c9f848f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1280 microversion: 2.1 time: 0.456223 May 17 12:06:53.163021 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 28/60] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:52 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1280 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:53.357736 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1310329580", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ff54b2b-d245-42b7-9e38-b4510eee82b9"}], "security_groups": [{"name": "tempest-securitygroup--213402007"}], "key_name": "tempest-keypair-1113558038", "user_data": "}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:53.714180 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ba16e727-0f5c-45f6-852a-3b9aa8e1ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:53.714825 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ba16e727-0f5c-45f6-852a-3b9aa8e1ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:53.727333 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ba16e727-0f5c-45f6-852a-3b9aa8e1ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:53.727790 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ba16e727-0f5c-45f6-852a-3b9aa8e1ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:53.728621 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ba16e727-0f5c-45f6-852a-3b9aa8e1ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:53.729066 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ba16e727-0f5c-45f6-852a-3b9aa8e1ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:54.048158 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] validate_networks() for [('9ff54b2b-d245-42b7-9e38-b4510eee82b9', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:06:54.615345 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ba16e727-0f5c-45f6-852a-3b9aa8e1ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:54.630788 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ba16e727-0f5c-45f6-852a-3b9aa8e1ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:54.632704 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ba16e727-0f5c-45f6-852a-3b9aa8e1ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:54.634409 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ba16e727-0f5c-45f6-852a-3b9aa8e1ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.924919 May 17 12:06:54.638161 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 29/61] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:06:53 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:06:54.646230 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-55a056b9-1cd3-4ae7-a63b-fffb6a3b4e6a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:54.647051 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-55a056b9-1cd3-4ae7-a63b-fffb6a3b4e6a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:54.669222 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-55a056b9-1cd3-4ae7-a63b-fffb6a3b4e6a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:54.672209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-55a056b9-1cd3-4ae7-a63b-fffb6a3b4e6a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:54.674442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-55a056b9-1cd3-4ae7-a63b-fffb6a3b4e6a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:54.676785 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-55a056b9-1cd3-4ae7-a63b-fffb6a3b4e6a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:55.209330 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-55a056b9-1cd3-4ae7-a63b-fffb6a3b4e6a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:55.224709 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-55a056b9-1cd3-4ae7-a63b-fffb6a3b4e6a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 0.582931 May 17 12:06:55.228530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 30/62] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:54 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:55.439812 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-8b177683-1670-4c2c-99fa-04b4d0f68de1 req-444c5ada-c89a-46fb-a308-fd9c7fa27b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120ebbd5-b659-4429-aae8-830d4b1f06d1", "name": "network-vif-plugged", "status": "completed", "tag": "2d56cb05-0c73-4387-b334-1a1670e55477"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:55.456353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-8b177683-1670-4c2c-99fa-04b4d0f68de1 req-444c5ada-c89a-46fb-a308-fd9c7fa27b30 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:55.457120 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-8b177683-1670-4c2c-99fa-04b4d0f68de1 req-444c5ada-c89a-46fb-a308-fd9c7fa27b30 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:55.477922 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-8b177683-1670-4c2c-99fa-04b4d0f68de1 req-444c5ada-c89a-46fb-a308-fd9c7fa27b30 service nova] Creating event network-vif-plugged:2d56cb05-0c73-4387-b334-1a1670e55477 for instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 on hv-cinder-83769 May 17 12:06:55.484777 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-8b177683-1670-4c2c-99fa-04b4d0f68de1 req-444c5ada-c89a-46fb-a308-fd9c7fa27b30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251758 May 17 12:06:55.492280 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 31/63] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:55.500231 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e63a703f-c4dc-4e4d-b391-746b7d276002 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:55.505127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e63a703f-c4dc-4e4d-b391-746b7d276002 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:55.512848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e63a703f-c4dc-4e4d-b391-746b7d276002 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:55.513573 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e63a703f-c4dc-4e4d-b391-746b7d276002 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:55.514687 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e63a703f-c4dc-4e4d-b391-746b7d276002 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:55.515071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e63a703f-c4dc-4e4d-b391-746b7d276002 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:55.657800 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:06:55.658924 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:06:55.659599 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:06:55.660253 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:06:55.661159 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:06:55.672812 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:55.673777 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:55.674834 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:55.675466 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:55.698945 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for project 27acd98621cd4a51ac46fb12e1824168. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:06:55.705857 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for user 586e15d5d16543e6b70c87fbf9079e9e and project 27acd98621cd4a51ac46fb12e1824168. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:06:55.729548 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:06:55.731819 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:06:55.787402 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-9a4dcc48-9889-45f2-93a5-3e509188d6a3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.433534 May 17 12:06:55.795495 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:06:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:06:55.800977 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9f493672-fcc5-4853-99df-cf865d60fb4d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:55.801591 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9f493672-fcc5-4853-99df-cf865d60fb4d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:55.808912 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9f493672-fcc5-4853-99df-cf865d60fb4d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:55.809361 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9f493672-fcc5-4853-99df-cf865d60fb4d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:55.810611 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9f493672-fcc5-4853-99df-cf865d60fb4d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:55.811056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9f493672-fcc5-4853-99df-cf865d60fb4d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:56.042656 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e63a703f-c4dc-4e4d-b391-746b7d276002 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:56.053630 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e63a703f-c4dc-4e4d-b391-746b7d276002 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.559711 May 17 12:06:56.055277 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 32/65] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:55 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:56.060859 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7200a7d4-075f-4d60-96b1-bbb5cc426cb1 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:56.064076 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7200a7d4-075f-4d60-96b1-bbb5cc426cb1 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:56.077497 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7200a7d4-075f-4d60-96b1-bbb5cc426cb1 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:56.087343 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7200a7d4-075f-4d60-96b1-bbb5cc426cb1 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:56.093506 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7200a7d4-075f-4d60-96b1-bbb5cc426cb1 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:56.094185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7200a7d4-075f-4d60-96b1-bbb5cc426cb1 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:56.401957 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-9f493672-fcc5-4853-99df-cf865d60fb4d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:56.412885 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-9f493672-fcc5-4853-99df-cf865d60fb4d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.615783 May 17 12:06:56.424443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 34/66] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:55 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:56.430689 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a1ecfc77-5a26-4949-85da-7dd5429dfdee tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:56.432960 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a1ecfc77-5a26-4949-85da-7dd5429dfdee tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:56.451512 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a1ecfc77-5a26-4949-85da-7dd5429dfdee tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:56.455979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a1ecfc77-5a26-4949-85da-7dd5429dfdee tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:56.458785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a1ecfc77-5a26-4949-85da-7dd5429dfdee tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:56.460155 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a1ecfc77-5a26-4949-85da-7dd5429dfdee tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:56.849778 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a1ecfc77-5a26-4949-85da-7dd5429dfdee tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:56.903516 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a1ecfc77-5a26-4949-85da-7dd5429dfdee tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1246 microversion: 2.1 time: 0.468673 May 17 12:06:56.904201 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 35/67] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:56 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1246 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:56.918081 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1a3bd79b-5762-46cb-9d87-eb682ab67526 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:56.924496 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1a3bd79b-5762-46cb-9d87-eb682ab67526 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:56.958412 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1a3bd79b-5762-46cb-9d87-eb682ab67526 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:56.960824 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1a3bd79b-5762-46cb-9d87-eb682ab67526 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:56.964632 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1a3bd79b-5762-46cb-9d87-eb682ab67526 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:56.966880 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1a3bd79b-5762-46cb-9d87-eb682ab67526 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:57.275187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7200a7d4-075f-4d60-96b1-bbb5cc426cb1 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:57.319143 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7200a7d4-075f-4d60-96b1-bbb5cc426cb1 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:57.331955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7200a7d4-075f-4d60-96b1-bbb5cc426cb1 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:57.333206 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7200a7d4-075f-4d60-96b1-bbb5cc426cb1 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 1.276175 May 17 12:06:57.339737 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 33/68] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:06:56 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:06:57.361666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cbcdd82b-93ef-4e23-aebe-fe6dc28138e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:57.366767 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cbcdd82b-93ef-4e23-aebe-fe6dc28138e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:57.398065 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cbcdd82b-93ef-4e23-aebe-fe6dc28138e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:57.402115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cbcdd82b-93ef-4e23-aebe-fe6dc28138e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:57.407819 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cbcdd82b-93ef-4e23-aebe-fe6dc28138e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:57.409905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cbcdd82b-93ef-4e23-aebe-fe6dc28138e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:57.499124 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1a3bd79b-5762-46cb-9d87-eb682ab67526 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:57.506973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1a3bd79b-5762-46cb-9d87-eb682ab67526 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 0.598508 May 17 12:06:57.507432 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 36/69] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:56 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:57.532445 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-f45ac482-52e0-432a-96a5-c095a8da556a req-feee6aa9-c187-41e9-bfa2-8356eb927183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883228f9-d4df-4582-b768-db398beae543", "tag": "fba3f606-e55d-4e33-884f-dc81bbb7d9e0"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:57.585288 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-f45ac482-52e0-432a-96a5-c095a8da556a req-feee6aa9-c187-41e9-bfa2-8356eb927183 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:57.586778 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-f45ac482-52e0-432a-96a5-c095a8da556a req-feee6aa9-c187-41e9-bfa2-8356eb927183 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:57.640415 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-f45ac482-52e0-432a-96a5-c095a8da556a req-feee6aa9-c187-41e9-bfa2-8356eb927183 service nova] Creating event network-changed:fba3f606-e55d-4e33-884f-dc81bbb7d9e0 for instance 883228f9-d4df-4582-b768-db398beae543 on hv-cinder-83769 May 17 12:06:57.641189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-f45ac482-52e0-432a-96a5-c095a8da556a req-feee6aa9-c187-41e9-bfa2-8356eb927183 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117113) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 12:06:57.643709 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6bb21d5e-8aec-4bfa-b3ee-88e61416bef2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:57.644754 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6bb21d5e-8aec-4bfa-b3ee-88e61416bef2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:57.646276 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6bb21d5e-8aec-4bfa-b3ee-88e61416bef2 None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:57.646940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6bb21d5e-8aec-4bfa-b3ee-88e61416bef2 None None] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:57.659022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.compute.rpcapi [None req-6bb21d5e-8aec-4bfa-b3ee-88e61416bef2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 12:06:57.660513 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6bb21d5e-8aec-4bfa-b3ee-88e61416bef2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117113) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 12:06:57.703322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6bb21d5e-8aec-4bfa-b3ee-88e61416bef2 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181294 May 17 12:06:57.705225 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 37/70] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:57.725087 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ca145293-e3c1-43a8-8072-cdd137a9744d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:57.725087 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ca145293-e3c1-43a8-8072-cdd137a9744d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:57.747260 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca145293-e3c1-43a8-8072-cdd137a9744d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:57.751055 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca145293-e3c1-43a8-8072-cdd137a9744d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:57.768295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca145293-e3c1-43a8-8072-cdd137a9744d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:57.769252 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca145293-e3c1-43a8-8072-cdd137a9744d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:57.833172 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cbcdd82b-93ef-4e23-aebe-fe6dc28138e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:57.842801 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cbcdd82b-93ef-4e23-aebe-fe6dc28138e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.497770 May 17 12:06:57.845295 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 34/71] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:57 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:57.920225 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-62454df3-c872-4eda-b6da-a2e2ff03e13f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:57.920850 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-62454df3-c872-4eda-b6da-a2e2ff03e13f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:57.937997 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62454df3-c872-4eda-b6da-a2e2ff03e13f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:57.939795 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62454df3-c872-4eda-b6da-a2e2ff03e13f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:57.940998 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62454df3-c872-4eda-b6da-a2e2ff03e13f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:57.941598 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62454df3-c872-4eda-b6da-a2e2ff03e13f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:58.035510 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-62454df3-c872-4eda-b6da-a2e2ff03e13f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:58.047254 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-62454df3-c872-4eda-b6da-a2e2ff03e13f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1312 microversion: 2.1 time: 0.130908 May 17 12:06:58.048276 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 35/72] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:57 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1312 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:06:58.138863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ca145293-e3c1-43a8-8072-cdd137a9744d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:58.149586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ca145293-e3c1-43a8-8072-cdd137a9744d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.441859 May 17 12:06:58.153918 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 38/73] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:57 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:58.257630 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-d0db30ab-8fbe-4840-bd20-81f04c0eb6fb req-46b0b444-d818-4969-9ca7-8ba17c454669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7d37bf-7c1d-43d6-9ede-a2e330b5a043", "tag": "b58f565e-dd05-47fe-9192-f26d8c0f0286"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:58.268963 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-d0db30ab-8fbe-4840-bd20-81f04c0eb6fb req-46b0b444-d818-4969-9ca7-8ba17c454669 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:58.269806 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-d0db30ab-8fbe-4840-bd20-81f04c0eb6fb req-46b0b444-d818-4969-9ca7-8ba17c454669 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:58.288955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-d0db30ab-8fbe-4840-bd20-81f04c0eb6fb req-46b0b444-d818-4969-9ca7-8ba17c454669 service nova] Creating event network-changed:b58f565e-dd05-47fe-9192-f26d8c0f0286 for instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 on hv-cinder-83769 May 17 12:06:58.302176 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-d0db30ab-8fbe-4840-bd20-81f04c0eb6fb req-46b0b444-d818-4969-9ca7-8ba17c454669 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.252516 May 17 12:06:58.303673 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 36/74] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:06:58.359907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-97d6076c-ea9c-4ef5-834e-b1e140b1f5b5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:58.361614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-97d6076c-ea9c-4ef5-834e-b1e140b1f5b5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:58.371804 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-97d6076c-ea9c-4ef5-834e-b1e140b1f5b5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:58.373468 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-97d6076c-ea9c-4ef5-834e-b1e140b1f5b5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:58.374790 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-97d6076c-ea9c-4ef5-834e-b1e140b1f5b5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:58.375134 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-97d6076c-ea9c-4ef5-834e-b1e140b1f5b5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:58.527155 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a9fefb14-9cc9-49c3-b71e-2283aeb62dea tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:58.529143 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a9fefb14-9cc9-49c3-b71e-2283aeb62dea tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:58.559005 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a9fefb14-9cc9-49c3-b71e-2283aeb62dea tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:58.560393 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a9fefb14-9cc9-49c3-b71e-2283aeb62dea tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:58.562294 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a9fefb14-9cc9-49c3-b71e-2283aeb62dea tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:58.563500 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a9fefb14-9cc9-49c3-b71e-2283aeb62dea tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:58.612756 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-97d6076c-ea9c-4ef5-834e-b1e140b1f5b5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:58.625971 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-97d6076c-ea9c-4ef5-834e-b1e140b1f5b5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:58.629857 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-97d6076c-ea9c-4ef5-834e-b1e140b1f5b5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:58.632359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-97d6076c-ea9c-4ef5-834e-b1e140b1f5b5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.278676 May 17 12:06:58.633511 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 39/75] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:06:58 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:06:58.731546 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a9fefb14-9cc9-49c3-b71e-2283aeb62dea tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:58.738655 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a9fefb14-9cc9-49c3-b71e-2283aeb62dea tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 0.217574 May 17 12:06:58.739223 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 37/76] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:58 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:06:58.864635 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fdb2080f-f749-4d2d-9d94-236e1a03fdad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:58.865722 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fdb2080f-f749-4d2d-9d94-236e1a03fdad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:58.873172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fdb2080f-f749-4d2d-9d94-236e1a03fdad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:58.873940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fdb2080f-f749-4d2d-9d94-236e1a03fdad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:58.875108 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fdb2080f-f749-4d2d-9d94-236e1a03fdad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:58.875823 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fdb2080f-f749-4d2d-9d94-236e1a03fdad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:59.065543 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-58b660b3-c48c-4271-8efd-9f5ac8855ca1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:59.066224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-58b660b3-c48c-4271-8efd-9f5ac8855ca1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:59.074290 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-58b660b3-c48c-4271-8efd-9f5ac8855ca1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:59.074654 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-58b660b3-c48c-4271-8efd-9f5ac8855ca1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:59.075430 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-58b660b3-c48c-4271-8efd-9f5ac8855ca1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:59.075873 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-58b660b3-c48c-4271-8efd-9f5ac8855ca1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:59.238662 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-58b660b3-c48c-4271-8efd-9f5ac8855ca1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:59.250593 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-58b660b3-c48c-4271-8efd-9f5ac8855ca1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1300 microversion: 2.1 time: 0.188952 May 17 12:06:59.251454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 38/77] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:59 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:59.266034 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-736ff01c-e4f0-4df5-abea-8da2fe07c4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:59.266952 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-736ff01c-e4f0-4df5-abea-8da2fe07c4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:59.278813 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-736ff01c-e4f0-4df5-abea-8da2fe07c4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:59.279935 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-736ff01c-e4f0-4df5-abea-8da2fe07c4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:59.282298 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-736ff01c-e4f0-4df5-abea-8da2fe07c4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:59.282782 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-736ff01c-e4f0-4df5-abea-8da2fe07c4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:59.609895 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-736ff01c-e4f0-4df5-abea-8da2fe07c4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:59.622063 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-736ff01c-e4f0-4df5-abea-8da2fe07c4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.369351 May 17 12:06:59.623229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 39/78] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:59 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:59.653527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cec8b2cf-f0cb-456c-9ed1-2d8e87b6bbe3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:59.654256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cec8b2cf-f0cb-456c-9ed1-2d8e87b6bbe3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:59.660529 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cec8b2cf-f0cb-456c-9ed1-2d8e87b6bbe3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:59.661252 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cec8b2cf-f0cb-456c-9ed1-2d8e87b6bbe3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:59.662208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cec8b2cf-f0cb-456c-9ed1-2d8e87b6bbe3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:59.662786 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cec8b2cf-f0cb-456c-9ed1-2d8e87b6bbe3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:59.688688 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-fdb2080f-f749-4d2d-9d94-236e1a03fdad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:59.700015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fdb2080f-f749-4d2d-9d94-236e1a03fdad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.841368 May 17 12:06:59.701461 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 40/79] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:58 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:06:59.756891 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-081d25c5-5544-4433-934c-6d6ab1cd2527 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:06:59.757839 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-081d25c5-5544-4433-934c-6d6ab1cd2527 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:06:59.766037 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-081d25c5-5544-4433-934c-6d6ab1cd2527 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:59.766770 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-081d25c5-5544-4433-934c-6d6ab1cd2527 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:59.767947 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-081d25c5-5544-4433-934c-6d6ab1cd2527 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:59.768629 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-081d25c5-5544-4433-934c-6d6ab1cd2527 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:59.824127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cec8b2cf-f0cb-456c-9ed1-2d8e87b6bbe3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:59.832261 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cec8b2cf-f0cb-456c-9ed1-2d8e87b6bbe3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:59.833792 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cec8b2cf-f0cb-456c-9ed1-2d8e87b6bbe3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:06:59.834912 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cec8b2cf-f0cb-456c-9ed1-2d8e87b6bbe3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.187742 May 17 12:06:59.835477 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 40/80] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:06:59 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:06:59.840221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-72c14303-f94a-49ad-84f3-91234d7fab1e req-a57ad0aa-90d3-47ad-a112-ad96167efab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d883f923-082e-4ee1-ba3e-0975ba2d7409", "tag": "cf6ad775-daff-4e4a-b3ee-b4652d53fdfe"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:06:59.847988 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-72c14303-f94a-49ad-84f3-91234d7fab1e req-a57ad0aa-90d3-47ad-a112-ad96167efab0 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:06:59.848571 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-72c14303-f94a-49ad-84f3-91234d7fab1e req-a57ad0aa-90d3-47ad-a112-ad96167efab0 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:06:59.864467 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-72c14303-f94a-49ad-84f3-91234d7fab1e req-a57ad0aa-90d3-47ad-a112-ad96167efab0 service nova] Creating event network-changed:cf6ad775-daff-4e4a-b3ee-b4652d53fdfe for instance d883f923-082e-4ee1-ba3e-0975ba2d7409 on hv-cinder-83769 May 17 12:06:59.870092 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-72c14303-f94a-49ad-84f3-91234d7fab1e req-a57ad0aa-90d3-47ad-a112-ad96167efab0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033048 May 17 12:06:59.870816 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 41/81] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:00.177843 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-081d25c5-5544-4433-934c-6d6ab1cd2527 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:00.185753 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-081d25c5-5544-4433-934c-6d6ab1cd2527 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 0.433601 May 17 12:07:00.186340 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 41/82] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:06:59 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:00.269917 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-933889a5-8d58-40e8-abdb-95080569474d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:00.271349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-933889a5-8d58-40e8-abdb-95080569474d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:00.290141 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-933889a5-8d58-40e8-abdb-95080569474d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:00.292789 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-933889a5-8d58-40e8-abdb-95080569474d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:00.293665 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-933889a5-8d58-40e8-abdb-95080569474d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:00.294639 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-933889a5-8d58-40e8-abdb-95080569474d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:00.334993 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-a5448a01-14c6-4e7b-9d59-46a9d6f02251 req-57ae853e-a467-4dea-a61d-a1476e5926e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3493dcda-ee1b-44a0-9bcf-e873bb341e4c", "tag": "107ece26-d721-49ba-a200-f81af98f0a51"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:00.349569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-a5448a01-14c6-4e7b-9d59-46a9d6f02251 req-57ae853e-a467-4dea-a61d-a1476e5926e9 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:00.350405 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-a5448a01-14c6-4e7b-9d59-46a9d6f02251 req-57ae853e-a467-4dea-a61d-a1476e5926e9 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:00.364114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-a5448a01-14c6-4e7b-9d59-46a9d6f02251 req-57ae853e-a467-4dea-a61d-a1476e5926e9 service nova] Creating event network-changed:107ece26-d721-49ba-a200-f81af98f0a51 for instance 3493dcda-ee1b-44a0-9bcf-e873bb341e4c on hv-cinder-83769 May 17 12:07:00.370278 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-a5448a01-14c6-4e7b-9d59-46a9d6f02251 req-57ae853e-a467-4dea-a61d-a1476e5926e9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038629 May 17 12:07:00.372119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 42/83] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:00.604756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-933889a5-8d58-40e8-abdb-95080569474d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:00.616320 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-933889a5-8d58-40e8-abdb-95080569474d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.351833 May 17 12:07:00.627097 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 42/84] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:00 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:00.639971 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-17595bcd-1c82-41f8-a5f1-f6c5b9492353 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:00.640714 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-17595bcd-1c82-41f8-a5f1-f6c5b9492353 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:00.648003 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17595bcd-1c82-41f8-a5f1-f6c5b9492353 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:00.649006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17595bcd-1c82-41f8-a5f1-f6c5b9492353 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:00.649806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17595bcd-1c82-41f8-a5f1-f6c5b9492353 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:00.652753 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17595bcd-1c82-41f8-a5f1-f6c5b9492353 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:00.717892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5bed71b7-f26d-4c9e-842e-0570698c3300 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:00.718532 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5bed71b7-f26d-4c9e-842e-0570698c3300 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:00.725505 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5bed71b7-f26d-4c9e-842e-0570698c3300 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:00.725967 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5bed71b7-f26d-4c9e-842e-0570698c3300 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:00.730071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5bed71b7-f26d-4c9e-842e-0570698c3300 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:00.731522 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5bed71b7-f26d-4c9e-842e-0570698c3300 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:00.870224 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-17595bcd-1c82-41f8-a5f1-f6c5b9492353 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:00.879177 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-17595bcd-1c82-41f8-a5f1-f6c5b9492353 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.243599 May 17 12:07:00.880327 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 43/85] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:00 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:00.887629 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ca852a5e-a103-452d-9fbb-d811c22f620d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:00.888419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ca852a5e-a103-452d-9fbb-d811c22f620d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:00.897245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca852a5e-a103-452d-9fbb-d811c22f620d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:00.897982 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca852a5e-a103-452d-9fbb-d811c22f620d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:00.899621 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca852a5e-a103-452d-9fbb-d811c22f620d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:00.900265 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca852a5e-a103-452d-9fbb-d811c22f620d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:01.073807 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ca852a5e-a103-452d-9fbb-d811c22f620d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:01.076410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5bed71b7-f26d-4c9e-842e-0570698c3300 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:01.083858 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ca852a5e-a103-452d-9fbb-d811c22f620d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:01.085271 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5bed71b7-f26d-4c9e-842e-0570698c3300 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.371226 May 17 12:07:01.086963 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ca852a5e-a103-452d-9fbb-d811c22f620d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:01.088435 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ca852a5e-a103-452d-9fbb-d811c22f620d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.206248 May 17 12:07:01.099084 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 43/86] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:00 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:01.099608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 44/87] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:00 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:07:01.206235 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-22c55798-ba1f-490e-9016-cea093ac1588 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:01.207220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-22c55798-ba1f-490e-9016-cea093ac1588 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:01.216376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-22c55798-ba1f-490e-9016-cea093ac1588 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:01.217247 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-22c55798-ba1f-490e-9016-cea093ac1588 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:01.218123 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-22c55798-ba1f-490e-9016-cea093ac1588 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:01.218770 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-22c55798-ba1f-490e-9016-cea093ac1588 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:01.402692 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-22c55798-ba1f-490e-9016-cea093ac1588 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:01.407490 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-22c55798-ba1f-490e-9016-cea093ac1588 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1314 microversion: 2.1 time: 0.207944 May 17 12:07:01.408225 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 44/88] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:01 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:01.636361 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ab941b7a-8fe5-47af-857d-59d5675ce8e8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:01.637538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ab941b7a-8fe5-47af-857d-59d5675ce8e8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:01.645372 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab941b7a-8fe5-47af-857d-59d5675ce8e8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:01.646059 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab941b7a-8fe5-47af-857d-59d5675ce8e8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:01.647461 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab941b7a-8fe5-47af-857d-59d5675ce8e8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:01.647896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab941b7a-8fe5-47af-857d-59d5675ce8e8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:01.900257 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a6214dd3-cf6f-4d03-9a02-744655761521 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:01.901525 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a6214dd3-cf6f-4d03-9a02-744655761521 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:01.907727 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a6214dd3-cf6f-4d03-9a02-744655761521 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:01.908460 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a6214dd3-cf6f-4d03-9a02-744655761521 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:01.909448 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a6214dd3-cf6f-4d03-9a02-744655761521 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:01.910131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a6214dd3-cf6f-4d03-9a02-744655761521 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:01.994242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ab941b7a-8fe5-47af-857d-59d5675ce8e8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:02.007829 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ab941b7a-8fe5-47af-857d-59d5675ce8e8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.376333 May 17 12:07:02.008776 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 45/89] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:01 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:02.094229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a6214dd3-cf6f-4d03-9a02-744655761521 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:02.105281 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d4238453-2612-44aa-9fa1-3468f15c8adc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:02.105906 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d4238453-2612-44aa-9fa1-3468f15c8adc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:02.108903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a6214dd3-cf6f-4d03-9a02-744655761521 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.213234 May 17 12:07:02.110843 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 45/90] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:01 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:02.123158 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d4238453-2612-44aa-9fa1-3468f15c8adc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:02.124021 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d4238453-2612-44aa-9fa1-3468f15c8adc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:02.124272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d05549f2-54e0-4edf-bd7f-a786a3a5637d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:02.124953 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d05549f2-54e0-4edf-bd7f-a786a3a5637d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:02.125374 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d4238453-2612-44aa-9fa1-3468f15c8adc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:02.126439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d4238453-2612-44aa-9fa1-3468f15c8adc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:02.138303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d05549f2-54e0-4edf-bd7f-a786a3a5637d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:02.140313 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d05549f2-54e0-4edf-bd7f-a786a3a5637d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:02.141139 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d05549f2-54e0-4edf-bd7f-a786a3a5637d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:02.142998 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d05549f2-54e0-4edf-bd7f-a786a3a5637d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:02.365649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d05549f2-54e0-4edf-bd7f-a786a3a5637d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:02.377531 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d05549f2-54e0-4edf-bd7f-a786a3a5637d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:02.379972 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d05549f2-54e0-4edf-bd7f-a786a3a5637d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:02.385794 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d05549f2-54e0-4edf-bd7f-a786a3a5637d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.272080 May 17 12:07:02.386369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 46/91] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:02 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:07:02.425189 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c3432b79-8098-4f48-a886-d24972c3dbd2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:02.425795 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c3432b79-8098-4f48-a886-d24972c3dbd2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:02.432137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3432b79-8098-4f48-a886-d24972c3dbd2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:02.432793 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3432b79-8098-4f48-a886-d24972c3dbd2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:02.434316 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3432b79-8098-4f48-a886-d24972c3dbd2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:02.434926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3432b79-8098-4f48-a886-d24972c3dbd2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:02.521928 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d4238453-2612-44aa-9fa1-3468f15c8adc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:02.532025 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d4238453-2612-44aa-9fa1-3468f15c8adc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.432573 May 17 12:07:02.542908 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 46/92] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:02 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:02.597256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c3432b79-8098-4f48-a886-d24972c3dbd2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:02.605057 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c3432b79-8098-4f48-a886-d24972c3dbd2 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1501 microversion: 2.1 time: 0.183568 May 17 12:07:02.606922 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 47/93] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:02 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:03.033180 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-38ac259b-7d01-4102-8a57-ca4c01d0904f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:03.035023 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-38ac259b-7d01-4102-8a57-ca4c01d0904f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:03.061942 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-38ac259b-7d01-4102-8a57-ca4c01d0904f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:03.061942 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-38ac259b-7d01-4102-8a57-ca4c01d0904f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:03.064593 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-38ac259b-7d01-4102-8a57-ca4c01d0904f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:03.066896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-38ac259b-7d01-4102-8a57-ca4c01d0904f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:03.127026 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d3880b1e-3522-44bb-a6bc-693b87fe1142 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:03.127774 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d3880b1e-3522-44bb-a6bc-693b87fe1142 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:03.138027 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d3880b1e-3522-44bb-a6bc-693b87fe1142 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:03.141232 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d3880b1e-3522-44bb-a6bc-693b87fe1142 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:03.144941 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d3880b1e-3522-44bb-a6bc-693b87fe1142 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:03.147897 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d3880b1e-3522-44bb-a6bc-693b87fe1142 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:03.543536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d3880b1e-3522-44bb-a6bc-693b87fe1142 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:03.554585 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d3880b1e-3522-44bb-a6bc-693b87fe1142 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.431618 May 17 12:07:03.558879 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 48/94] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:03 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:03.599676 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-38ac259b-7d01-4102-8a57-ca4c01d0904f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:03.625376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-fd67615d-09bb-4828-a890-6f0189696358 req-891a0afc-9c97-42b3-b8f9-9459d6fcc823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed125da4-128c-4d7e-ae52-d42f71475d0d", "tag": "e9c1c53c-8160-4739-98f3-05a522031fb3"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:03.628602 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-38ac259b-7d01-4102-8a57-ca4c01d0904f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.590020 May 17 12:07:03.643942 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 47/95] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:03 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:03.656056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7b66dc9c-d4d2-4219-b7d3-bf8d0bc262e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:03.657453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7b66dc9c-d4d2-4219-b7d3-bf8d0bc262e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:03.658588 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-fd67615d-09bb-4828-a890-6f0189696358 req-891a0afc-9c97-42b3-b8f9-9459d6fcc823 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:03.661540 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-fd67615d-09bb-4828-a890-6f0189696358 req-891a0afc-9c97-42b3-b8f9-9459d6fcc823 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:03.687483 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7b66dc9c-d4d2-4219-b7d3-bf8d0bc262e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:03.705072 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-fd67615d-09bb-4828-a890-6f0189696358 req-891a0afc-9c97-42b3-b8f9-9459d6fcc823 service nova] Creating event network-changed:e9c1c53c-8160-4739-98f3-05a522031fb3 for instance ed125da4-128c-4d7e-ae52-d42f71475d0d on hv-cinder-83769 May 17 12:07:03.709809 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7b66dc9c-d4d2-4219-b7d3-bf8d0bc262e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:03.716293 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-fd67615d-09bb-4828-a890-6f0189696358 req-891a0afc-9c97-42b3-b8f9-9459d6fcc823 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145908 May 17 12:07:03.716900 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 49/96] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:03.720801 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7b66dc9c-d4d2-4219-b7d3-bf8d0bc262e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:03.721218 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7b66dc9c-d4d2-4219-b7d3-bf8d0bc262e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:03.729197 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-66ff3634-429a-430e-97e8-ef7837e1feea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:03.730279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-66ff3634-429a-430e-97e8-ef7837e1feea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:03.737515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-66ff3634-429a-430e-97e8-ef7837e1feea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:03.738243 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-66ff3634-429a-430e-97e8-ef7837e1feea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:03.739378 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-66ff3634-429a-430e-97e8-ef7837e1feea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:03.740017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-66ff3634-429a-430e-97e8-ef7837e1feea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:03.949294 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7b66dc9c-d4d2-4219-b7d3-bf8d0bc262e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:03.960807 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7b66dc9c-d4d2-4219-b7d3-bf8d0bc262e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:03.972610 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7b66dc9c-d4d2-4219-b7d3-bf8d0bc262e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:03.974163 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7b66dc9c-d4d2-4219-b7d3-bf8d0bc262e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.328957 May 17 12:07:03.975238 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 48/97] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:03 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:07:04.009457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-66ff3634-429a-430e-97e8-ef7837e1feea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:04.018817 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-66ff3634-429a-430e-97e8-ef7837e1feea tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.295530 May 17 12:07:04.020338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 50/98] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:03 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:04.200890 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-39302759-1d15-4a60-a5a9-a7278ac3f8c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54ccfa65-7de4-4e44-aeb4-e70ac6760ce2"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:04.203401 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-39302759-1d15-4a60-a5a9-a7278ac3f8c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:04.217094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-39302759-1d15-4a60-a5a9-a7278ac3f8c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:04.218406 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-39302759-1d15-4a60-a5a9-a7278ac3f8c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:04.220848 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-39302759-1d15-4a60-a5a9-a7278ac3f8c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:04.221503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-39302759-1d15-4a60-a5a9-a7278ac3f8c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:04.575007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e548a5c4-78f2-432c-93cd-dc47c6b9ac53 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:04.575691 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e548a5c4-78f2-432c-93cd-dc47c6b9ac53 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:04.581670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e548a5c4-78f2-432c-93cd-dc47c6b9ac53 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:04.582245 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e548a5c4-78f2-432c-93cd-dc47c6b9ac53 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:04.583186 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e548a5c4-78f2-432c-93cd-dc47c6b9ac53 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:04.583623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e548a5c4-78f2-432c-93cd-dc47c6b9ac53 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:04.748873 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e548a5c4-78f2-432c-93cd-dc47c6b9ac53 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:04.757377 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e548a5c4-78f2-432c-93cd-dc47c6b9ac53 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.186087 May 17 12:07:04.766759 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 51/99] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:04 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:04.766759 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-186750d2-f6d5-4ecb-b7d3-ee5ae45145fe tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:04.766759 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-186750d2-f6d5-4ecb-b7d3-ee5ae45145fe tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:04.769833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-186750d2-f6d5-4ecb-b7d3-ee5ae45145fe tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:04.770279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-186750d2-f6d5-4ecb-b7d3-ee5ae45145fe tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:04.771126 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-186750d2-f6d5-4ecb-b7d3-ee5ae45145fe tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:04.771589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-186750d2-f6d5-4ecb-b7d3-ee5ae45145fe tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:04.958948 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-186750d2-f6d5-4ecb-b7d3-ee5ae45145fe tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:04.967874 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-186750d2-f6d5-4ecb-b7d3-ee5ae45145fe tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.208011 May 17 12:07:04.976341 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 52/100] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:04 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:04.995824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c574876d-5700-4710-8409-8d0264a73b95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:04.996684 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c574876d-5700-4710-8409-8d0264a73b95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:05.003927 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c574876d-5700-4710-8409-8d0264a73b95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:05.004416 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c574876d-5700-4710-8409-8d0264a73b95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:05.005242 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c574876d-5700-4710-8409-8d0264a73b95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:05.005684 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c574876d-5700-4710-8409-8d0264a73b95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:05.139603 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c574876d-5700-4710-8409-8d0264a73b95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:05.147863 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c574876d-5700-4710-8409-8d0264a73b95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:05.156263 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c574876d-5700-4710-8409-8d0264a73b95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:05.158375 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c574876d-5700-4710-8409-8d0264a73b95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.167540 May 17 12:07:05.159395 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 53/101] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:04 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:07:05.168486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4f93b6b5-7c59-4b3c-be23-7797556773c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:05.170177 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4f93b6b5-7c59-4b3c-be23-7797556773c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:05.181876 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f93b6b5-7c59-4b3c-be23-7797556773c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:05.182610 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f93b6b5-7c59-4b3c-be23-7797556773c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:05.183600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f93b6b5-7c59-4b3c-be23-7797556773c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:05.184276 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f93b6b5-7c59-4b3c-be23-7797556773c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:05.345272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4f93b6b5-7c59-4b3c-be23-7797556773c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:05.354046 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4f93b6b5-7c59-4b3c-be23-7797556773c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.193169 May 17 12:07:05.356887 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 54/102] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:05 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:05.439764 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-50f06fca-0d2c-41f0-8415-fb84c52c8b2c req-aa59b38a-80d7-4cfa-b09a-ff5ed89d3151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883228f9-d4df-4582-b768-db398beae543", "name": "network-vif-plugged", "status": "completed", "tag": "fba3f606-e55d-4e33-884f-dc81bbb7d9e0"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:05.452797 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-50f06fca-0d2c-41f0-8415-fb84c52c8b2c req-aa59b38a-80d7-4cfa-b09a-ff5ed89d3151 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:05.453828 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-50f06fca-0d2c-41f0-8415-fb84c52c8b2c req-aa59b38a-80d7-4cfa-b09a-ff5ed89d3151 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:05.483590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-50f06fca-0d2c-41f0-8415-fb84c52c8b2c req-aa59b38a-80d7-4cfa-b09a-ff5ed89d3151 service nova] Creating event network-vif-plugged:fba3f606-e55d-4e33-884f-dc81bbb7d9e0 for instance 883228f9-d4df-4582-b768-db398beae543 on hv-cinder-83769 May 17 12:07:05.490925 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-50f06fca-0d2c-41f0-8415-fb84c52c8b2c req-aa59b38a-80d7-4cfa-b09a-ff5ed89d3151 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055186 May 17 12:07:05.491651 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 55/103] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:07:05.775825 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cf2074f5-0c01-46c1-8415-78d095891575 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:05.776766 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cf2074f5-0c01-46c1-8415-78d095891575 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:05.783025 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cf2074f5-0c01-46c1-8415-78d095891575 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:05.783550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cf2074f5-0c01-46c1-8415-78d095891575 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:05.784441 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cf2074f5-0c01-46c1-8415-78d095891575 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:05.784952 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cf2074f5-0c01-46c1-8415-78d095891575 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:05.918204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cf2074f5-0c01-46c1-8415-78d095891575 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:05.926175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cf2074f5-0c01-46c1-8415-78d095891575 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.155097 May 17 12:07:05.926853 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 56/104] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:05 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:05.986998 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7effb71c-b72f-4b35-b0c7-ce3b49efce05 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:05.987586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7effb71c-b72f-4b35-b0c7-ce3b49efce05 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:05.996388 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7effb71c-b72f-4b35-b0c7-ce3b49efce05 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:05.996861 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7effb71c-b72f-4b35-b0c7-ce3b49efce05 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:05.997647 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7effb71c-b72f-4b35-b0c7-ce3b49efce05 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:05.998090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7effb71c-b72f-4b35-b0c7-ce3b49efce05 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:06.151923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7effb71c-b72f-4b35-b0c7-ce3b49efce05 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:06.161023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7effb71c-b72f-4b35-b0c7-ce3b49efce05 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.178412 May 17 12:07:06.162124 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 57/105] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:05 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:06.178538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ab708e61-d2f4-4c08-8075-860232ba002d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:06.179159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ab708e61-d2f4-4c08-8075-860232ba002d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:06.185245 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ab708e61-d2f4-4c08-8075-860232ba002d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:06.185759 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ab708e61-d2f4-4c08-8075-860232ba002d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:06.186540 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ab708e61-d2f4-4c08-8075-860232ba002d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:06.186977 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ab708e61-d2f4-4c08-8075-860232ba002d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:06.318633 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ab708e61-d2f4-4c08-8075-860232ba002d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:06.327426 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ab708e61-d2f4-4c08-8075-860232ba002d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:06.329171 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ab708e61-d2f4-4c08-8075-860232ba002d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:06.330353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ab708e61-d2f4-4c08-8075-860232ba002d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.155883 May 17 12:07:06.331991 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 58/106] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:06 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:07:06.372210 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-38c2d7da-e9ec-48db-9484-ab443f5d948a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:06.372826 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-38c2d7da-e9ec-48db-9484-ab443f5d948a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:06.378817 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38c2d7da-e9ec-48db-9484-ab443f5d948a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:06.379368 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38c2d7da-e9ec-48db-9484-ab443f5d948a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:06.380298 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38c2d7da-e9ec-48db-9484-ab443f5d948a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:06.380835 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38c2d7da-e9ec-48db-9484-ab443f5d948a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:06.516966 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-38c2d7da-e9ec-48db-9484-ab443f5d948a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:06.525428 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-38c2d7da-e9ec-48db-9484-ab443f5d948a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.156865 May 17 12:07:06.535038 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 59/107] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:06 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:06.943863 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9d70bf13-d0a1-436d-9f92-fa05e4c7e093 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:06.945078 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9d70bf13-d0a1-436d-9f92-fa05e4c7e093 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:06.955650 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9d70bf13-d0a1-436d-9f92-fa05e4c7e093 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:06.956380 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9d70bf13-d0a1-436d-9f92-fa05e4c7e093 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:06.957410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9d70bf13-d0a1-436d-9f92-fa05e4c7e093 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:06.957876 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9d70bf13-d0a1-436d-9f92-fa05e4c7e093 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:07.127762 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9d70bf13-d0a1-436d-9f92-fa05e4c7e093 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:07.136122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9d70bf13-d0a1-436d-9f92-fa05e4c7e093 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.197032 May 17 12:07:07.137992 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 60/108] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:06 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:07.179085 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f2e06185-565d-4b3f-97a5-45b7201aac09 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:07.180380 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f2e06185-565d-4b3f-97a5-45b7201aac09 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:07.187230 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2e06185-565d-4b3f-97a5-45b7201aac09 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:07.187885 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2e06185-565d-4b3f-97a5-45b7201aac09 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:07.188950 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2e06185-565d-4b3f-97a5-45b7201aac09 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:07.189345 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2e06185-565d-4b3f-97a5-45b7201aac09 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:07.358126 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f2e06185-565d-4b3f-97a5-45b7201aac09 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:07.365630 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f2e06185-565d-4b3f-97a5-45b7201aac09 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.190779 May 17 12:07:07.376585 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 61/109] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:07 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:07.381707 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e49c1eae-2820-4a52-a008-409dc9c4ef85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:07.382519 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e49c1eae-2820-4a52-a008-409dc9c4ef85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:07.389217 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e49c1eae-2820-4a52-a008-409dc9c4ef85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:07.390175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e49c1eae-2820-4a52-a008-409dc9c4ef85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:07.391154 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e49c1eae-2820-4a52-a008-409dc9c4ef85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:07.391615 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e49c1eae-2820-4a52-a008-409dc9c4ef85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:07.573240 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e49c1eae-2820-4a52-a008-409dc9c4ef85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:07.582572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e49c1eae-2820-4a52-a008-409dc9c4ef85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:07.584274 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e49c1eae-2820-4a52-a008-409dc9c4ef85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:07.585506 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e49c1eae-2820-4a52-a008-409dc9c4ef85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.207740 May 17 12:07:07.586296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 62/110] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:07 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:07:07.599622 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-aae22743-04fa-47ad-a67a-ddd624c1de68 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:07.600290 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-aae22743-04fa-47ad-a67a-ddd624c1de68 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:07.611127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aae22743-04fa-47ad-a67a-ddd624c1de68 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:07.611810 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aae22743-04fa-47ad-a67a-ddd624c1de68 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:07.612947 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aae22743-04fa-47ad-a67a-ddd624c1de68 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:07.613674 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aae22743-04fa-47ad-a67a-ddd624c1de68 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:07.803098 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-aae22743-04fa-47ad-a67a-ddd624c1de68 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:07.808035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-aae22743-04fa-47ad-a67a-ddd624c1de68 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.220573 May 17 12:07:07.808725 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 63/111] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:07 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:08.154721 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-578f4916-654b-4035-9295-8d9f82cb6df6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:08.155394 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-578f4916-654b-4035-9295-8d9f82cb6df6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:08.162252 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-578f4916-654b-4035-9295-8d9f82cb6df6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:08.162703 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-578f4916-654b-4035-9295-8d9f82cb6df6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:08.163692 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-578f4916-654b-4035-9295-8d9f82cb6df6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:08.165109 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-578f4916-654b-4035-9295-8d9f82cb6df6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:08.303808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-578f4916-654b-4035-9295-8d9f82cb6df6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:08.312848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-578f4916-654b-4035-9295-8d9f82cb6df6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.162701 May 17 12:07:08.316260 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 64/112] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:08 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:08.383886 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f8fe06d1-9c91-4c03-9a86-68820473768c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:08.384439 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f8fe06d1-9c91-4c03-9a86-68820473768c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:08.390450 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f8fe06d1-9c91-4c03-9a86-68820473768c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:08.390904 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f8fe06d1-9c91-4c03-9a86-68820473768c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:08.391735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f8fe06d1-9c91-4c03-9a86-68820473768c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:08.392171 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f8fe06d1-9c91-4c03-9a86-68820473768c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:08.523196 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f8fe06d1-9c91-4c03-9a86-68820473768c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:08.530882 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f8fe06d1-9c91-4c03-9a86-68820473768c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.151567 May 17 12:07:08.531524 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 65/113] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:08 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:08.604486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3a684846-5985-4098-97f8-467b8f3c11f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:08.605339 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3a684846-5985-4098-97f8-467b8f3c11f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:08.611279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3a684846-5985-4098-97f8-467b8f3c11f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:08.611794 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3a684846-5985-4098-97f8-467b8f3c11f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:08.612653 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3a684846-5985-4098-97f8-467b8f3c11f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:08.613151 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3a684846-5985-4098-97f8-467b8f3c11f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:08.749039 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3a684846-5985-4098-97f8-467b8f3c11f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:08.757071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3a684846-5985-4098-97f8-467b8f3c11f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:08.758717 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3a684846-5985-4098-97f8-467b8f3c11f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:08.759881 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3a684846-5985-4098-97f8-467b8f3c11f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.160339 May 17 12:07:08.760577 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 66/114] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:08 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:07:08.825257 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ea578fef-607c-4ed1-80c3-c329c9ede0fe tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:08.826183 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ea578fef-607c-4ed1-80c3-c329c9ede0fe tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:08.835799 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ea578fef-607c-4ed1-80c3-c329c9ede0fe tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:08.837996 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ea578fef-607c-4ed1-80c3-c329c9ede0fe tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:08.839400 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ea578fef-607c-4ed1-80c3-c329c9ede0fe tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:08.840032 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ea578fef-607c-4ed1-80c3-c329c9ede0fe tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:08.977970 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ea578fef-607c-4ed1-80c3-c329c9ede0fe tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:08.990076 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ea578fef-607c-4ed1-80c3-c329c9ede0fe tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.168466 May 17 12:07:08.990744 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 67/115] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:08 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:09.335745 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a91392e9-be92-410e-8418-11c450303693 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:09.341439 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a91392e9-be92-410e-8418-11c450303693 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:09.363042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a91392e9-be92-410e-8418-11c450303693 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:09.372108 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a91392e9-be92-410e-8418-11c450303693 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:09.394324 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a91392e9-be92-410e-8418-11c450303693 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:09.395696 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a91392e9-be92-410e-8418-11c450303693 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:09.549338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-39302759-1d15-4a60-a5a9-a7278ac3f8c6 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "POST /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.353657 May 17 12:07:09.560410 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 49/116] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:07:04 2022] POST /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1/os-volume_attachments => generated 194 bytes in 5366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:09.573121 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-30a46e62-28ae-48a4-9d8f-3d6c2e443b8f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:09.574614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-30a46e62-28ae-48a4-9d8f-3d6c2e443b8f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:09.583295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-30a46e62-28ae-48a4-9d8f-3d6c2e443b8f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:09.584133 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-30a46e62-28ae-48a4-9d8f-3d6c2e443b8f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:09.585381 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-30a46e62-28ae-48a4-9d8f-3d6c2e443b8f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:09.587072 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-30a46e62-28ae-48a4-9d8f-3d6c2e443b8f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:09.655153 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a91392e9-be92-410e-8418-11c450303693 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:09.666580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a91392e9-be92-410e-8418-11c450303693 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.340499 May 17 12:07:09.667164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 68/117] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:09 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:09.778525 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fa236316-1b7d-4175-8968-f2db4207dbc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:09.779147 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fa236316-1b7d-4175-8968-f2db4207dbc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:09.790261 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa236316-1b7d-4175-8968-f2db4207dbc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:09.790962 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa236316-1b7d-4175-8968-f2db4207dbc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:09.791907 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa236316-1b7d-4175-8968-f2db4207dbc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:09.792549 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa236316-1b7d-4175-8968-f2db4207dbc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:09.825250 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-30a46e62-28ae-48a4-9d8f-3d6c2e443b8f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:09.837974 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-30a46e62-28ae-48a4-9d8f-3d6c2e443b8f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.274779 May 17 12:07:09.838673 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 50/118] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:09 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:09.976935 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fa236316-1b7d-4175-8968-f2db4207dbc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:09.985172 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fa236316-1b7d-4175-8968-f2db4207dbc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:09.986735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fa236316-1b7d-4175-8968-f2db4207dbc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:09.987839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fa236316-1b7d-4175-8968-f2db4207dbc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.214273 May 17 12:07:09.988416 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 69/119] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:09 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:07:10.010802 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fc5a3784-0fd4-41c6-ab7c-494f12133541 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:10.013153 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fc5a3784-0fd4-41c6-ab7c-494f12133541 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:10.022671 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fc5a3784-0fd4-41c6-ab7c-494f12133541 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:10.023126 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fc5a3784-0fd4-41c6-ab7c-494f12133541 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:10.024508 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fc5a3784-0fd4-41c6-ab7c-494f12133541 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:10.024949 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fc5a3784-0fd4-41c6-ab7c-494f12133541 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:10.216995 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-fc5a3784-0fd4-41c6-ab7c-494f12133541 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:10.225176 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fc5a3784-0fd4-41c6-ab7c-494f12133541 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.218564 May 17 12:07:10.225959 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 51/120] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:10 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:10.683490 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d2ad8537-24f5-4b59-a0af-012de53a6361 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:10.684222 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d2ad8537-24f5-4b59-a0af-012de53a6361 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:10.692076 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2ad8537-24f5-4b59-a0af-012de53a6361 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:10.692844 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2ad8537-24f5-4b59-a0af-012de53a6361 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:10.693821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2ad8537-24f5-4b59-a0af-012de53a6361 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:10.694696 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2ad8537-24f5-4b59-a0af-012de53a6361 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:10.807575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-242e4dff-f8bc-42a7-9129-d50aa89d5492 req-71ae4896-4494-49d8-a641-0246fd22b5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3493dcda-ee1b-44a0-9bcf-e873bb341e4c", "name": "network-vif-plugged", "status": "completed", "tag": "107ece26-d721-49ba-a200-f81af98f0a51"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:10.825864 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-242e4dff-f8bc-42a7-9129-d50aa89d5492 req-71ae4896-4494-49d8-a641-0246fd22b5e3 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:10.827783 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-242e4dff-f8bc-42a7-9129-d50aa89d5492 req-71ae4896-4494-49d8-a641-0246fd22b5e3 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:10.850558 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-242e4dff-f8bc-42a7-9129-d50aa89d5492 req-71ae4896-4494-49d8-a641-0246fd22b5e3 service nova] Creating event network-vif-plugged:107ece26-d721-49ba-a200-f81af98f0a51 for instance 3493dcda-ee1b-44a0-9bcf-e873bb341e4c on hv-cinder-83769 May 17 12:07:10.858760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-242e4dff-f8bc-42a7-9129-d50aa89d5492 req-71ae4896-4494-49d8-a641-0246fd22b5e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058129 May 17 12:07:10.860546 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 52/121] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:10.867898 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-45a0524b-dd6f-47d1-a9bb-a8536abcff46 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:10.869852 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-45a0524b-dd6f-47d1-a9bb-a8536abcff46 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:10.885191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-45a0524b-dd6f-47d1-a9bb-a8536abcff46 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:10.886015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-45a0524b-dd6f-47d1-a9bb-a8536abcff46 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:10.887541 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-45a0524b-dd6f-47d1-a9bb-a8536abcff46 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:10.888268 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-45a0524b-dd6f-47d1-a9bb-a8536abcff46 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:10.924498 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d2ad8537-24f5-4b59-a0af-012de53a6361 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:10.933482 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d2ad8537-24f5-4b59-a0af-012de53a6361 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.253878 May 17 12:07:10.934068 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 70/122] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:10 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:11.005575 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f04a3771-7285-4f18-a58f-52310423bcf5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:11.006177 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f04a3771-7285-4f18-a58f-52310423bcf5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:11.015090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f04a3771-7285-4f18-a58f-52310423bcf5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:11.015090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f04a3771-7285-4f18-a58f-52310423bcf5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:11.015090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f04a3771-7285-4f18-a58f-52310423bcf5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:11.015090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f04a3771-7285-4f18-a58f-52310423bcf5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:11.123682 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-45a0524b-dd6f-47d1-a9bb-a8536abcff46 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:11.132310 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-45a0524b-dd6f-47d1-a9bb-a8536abcff46 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.270412 May 17 12:07:11.134109 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 53/123] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:10 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:11.222178 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f04a3771-7285-4f18-a58f-52310423bcf5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:11.235378 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f04a3771-7285-4f18-a58f-52310423bcf5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:11.243364 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a7637836-4b59-459a-a065-7e3c55da36e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:11.244244 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a7637836-4b59-459a-a065-7e3c55da36e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:11.254461 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f04a3771-7285-4f18-a58f-52310423bcf5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:11.255914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f04a3771-7285-4f18-a58f-52310423bcf5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.254062 May 17 12:07:11.258037 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7637836-4b59-459a-a065-7e3c55da36e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:11.258500 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7637836-4b59-459a-a065-7e3c55da36e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:11.259266 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7637836-4b59-459a-a065-7e3c55da36e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:11.259717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7637836-4b59-459a-a065-7e3c55da36e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:11.261430 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 71/124] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:11 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:07:11.641938 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a7637836-4b59-459a-a065-7e3c55da36e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:11.649199 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a7637836-4b59-459a-a065-7e3c55da36e6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.409031 May 17 12:07:11.649956 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 54/125] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:11 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:11.954956 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-debe9f89-101d-4e61-ba31-15f034bc5ffe tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:11.957443 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-debe9f89-101d-4e61-ba31-15f034bc5ffe tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:11.967738 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-debe9f89-101d-4e61-ba31-15f034bc5ffe tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:11.968566 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-debe9f89-101d-4e61-ba31-15f034bc5ffe tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:11.970109 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-debe9f89-101d-4e61-ba31-15f034bc5ffe tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:11.970787 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-debe9f89-101d-4e61-ba31-15f034bc5ffe tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:12.128360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-debe9f89-101d-4e61-ba31-15f034bc5ffe tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:12.136243 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-debe9f89-101d-4e61-ba31-15f034bc5ffe tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.188294 May 17 12:07:12.136976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 72/126] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:11 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:12.150254 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3033e0ff-8943-46cc-9491-e6e3148e635f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:12.151070 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-3033e0ff-8943-46cc-9491-e6e3148e635f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:12.157723 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3033e0ff-8943-46cc-9491-e6e3148e635f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:12.158189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3033e0ff-8943-46cc-9491-e6e3148e635f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:12.160442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3033e0ff-8943-46cc-9491-e6e3148e635f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:12.160442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3033e0ff-8943-46cc-9491-e6e3148e635f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:12.279063 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-745114d0-8b14-4450-a945-ea2aaddfb68c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:12.280003 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-745114d0-8b14-4450-a945-ea2aaddfb68c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:12.292379 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-745114d0-8b14-4450-a945-ea2aaddfb68c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:12.293096 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-745114d0-8b14-4450-a945-ea2aaddfb68c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:12.294312 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-745114d0-8b14-4450-a945-ea2aaddfb68c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:12.294880 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-745114d0-8b14-4450-a945-ea2aaddfb68c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:12.449606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-745114d0-8b14-4450-a945-ea2aaddfb68c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:12.462787 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-745114d0-8b14-4450-a945-ea2aaddfb68c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:12.464787 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-745114d0-8b14-4450-a945-ea2aaddfb68c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:12.466262 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-745114d0-8b14-4450-a945-ea2aaddfb68c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.191602 May 17 12:07:12.467319 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 73/127] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:12 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:07:12.468756 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3033e0ff-8943-46cc-9491-e6e3148e635f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:12.478560 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-3033e0ff-8943-46cc-9491-e6e3148e635f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.332206 May 17 12:07:12.480766 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 55/128] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:12 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:12.665629 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ad385947-6a86-4b38-b027-f1dfa779ad92 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:12.666472 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ad385947-6a86-4b38-b027-f1dfa779ad92 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:12.673113 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad385947-6a86-4b38-b027-f1dfa779ad92 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:12.673675 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad385947-6a86-4b38-b027-f1dfa779ad92 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:12.674651 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad385947-6a86-4b38-b027-f1dfa779ad92 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:12.675159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad385947-6a86-4b38-b027-f1dfa779ad92 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:12.819521 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ad385947-6a86-4b38-b027-f1dfa779ad92 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:12.827780 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ad385947-6a86-4b38-b027-f1dfa779ad92 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.166097 May 17 12:07:12.828386 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 74/129] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:12 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:12.888165 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-f0a0872a-8a58-4545-bb5b-83341cb4091c req-9181d89c-20ab-40c4-bf5c-be9c9a4826a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7d37bf-7c1d-43d6-9ede-a2e330b5a043", "name": "network-vif-plugged", "status": "completed", "tag": "b58f565e-dd05-47fe-9192-f26d8c0f0286"}, {"server_uuid": "d883f923-082e-4ee1-ba3e-0975ba2d7409", "name": "network-vif-plugged", "status": "completed", "tag": "cf6ad775-daff-4e4a-b3ee-b4652d53fdfe"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:12.897015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-f0a0872a-8a58-4545-bb5b-83341cb4091c req-9181d89c-20ab-40c4-bf5c-be9c9a4826a9 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:12.897454 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-f0a0872a-8a58-4545-bb5b-83341cb4091c req-9181d89c-20ab-40c4-bf5c-be9c9a4826a9 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:12.911282 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-f0a0872a-8a58-4545-bb5b-83341cb4091c req-9181d89c-20ab-40c4-bf5c-be9c9a4826a9 service nova] Creating event network-vif-plugged:b58f565e-dd05-47fe-9192-f26d8c0f0286 for instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 on hv-cinder-83769 May 17 12:07:12.912064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-f0a0872a-8a58-4545-bb5b-83341cb4091c req-9181d89c-20ab-40c4-bf5c-be9c9a4826a9 service nova] Creating event network-vif-plugged:cf6ad775-daff-4e4a-b3ee-b4652d53fdfe for instance d883f923-082e-4ee1-ba3e-0975ba2d7409 on hv-cinder-83769 May 17 12:07:12.918685 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-f0a0872a-8a58-4545-bb5b-83341cb4091c req-9181d89c-20ab-40c4-bf5c-be9c9a4826a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034070 May 17 12:07:12.919350 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 56/130] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:07:13.153667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2a49353b-74de-435e-a922-a0fb65492c2b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:13.154418 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2a49353b-74de-435e-a922-a0fb65492c2b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:13.160450 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a49353b-74de-435e-a922-a0fb65492c2b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:13.161283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a49353b-74de-435e-a922-a0fb65492c2b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:13.162359 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a49353b-74de-435e-a922-a0fb65492c2b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:13.162952 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a49353b-74de-435e-a922-a0fb65492c2b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:13.319660 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2a49353b-74de-435e-a922-a0fb65492c2b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:13.326989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2a49353b-74de-435e-a922-a0fb65492c2b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.177249 May 17 12:07:13.327555 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 75/131] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:13 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:13.485843 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2913ad1c-4f5d-4082-9452-0ea7779b1466 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:13.486572 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2913ad1c-4f5d-4082-9452-0ea7779b1466 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:13.493142 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2913ad1c-4f5d-4082-9452-0ea7779b1466 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:13.493906 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2913ad1c-4f5d-4082-9452-0ea7779b1466 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:13.494758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2913ad1c-4f5d-4082-9452-0ea7779b1466 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:13.495261 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2913ad1c-4f5d-4082-9452-0ea7779b1466 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:13.496014 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-17feef58-63e1-4d4c-b4f4-83b0f3cefcad tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:13.497095 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-17feef58-63e1-4d4c-b4f4-83b0f3cefcad tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:13.503287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-17feef58-63e1-4d4c-b4f4-83b0f3cefcad tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:13.503574 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-17feef58-63e1-4d4c-b4f4-83b0f3cefcad tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:13.504703 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-17feef58-63e1-4d4c-b4f4-83b0f3cefcad tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:13.505296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-17feef58-63e1-4d4c-b4f4-83b0f3cefcad tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:13.688252 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-17feef58-63e1-4d4c-b4f4-83b0f3cefcad tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:13.700553 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-17feef58-63e1-4d4c-b4f4-83b0f3cefcad tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.208167 May 17 12:07:13.701572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 76/132] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:13 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:13.716378 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2913ad1c-4f5d-4082-9452-0ea7779b1466 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:13.724596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2913ad1c-4f5d-4082-9452-0ea7779b1466 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:13.726102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2913ad1c-4f5d-4082-9452-0ea7779b1466 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:13.727931 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2913ad1c-4f5d-4082-9452-0ea7779b1466 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.246689 May 17 12:07:13.728534 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 57/133] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:13 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:07:13.844758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e1b7c059-88d3-48eb-b07b-3839e74681e9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:13.845365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e1b7c059-88d3-48eb-b07b-3839e74681e9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:13.851107 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e1b7c059-88d3-48eb-b07b-3839e74681e9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:13.852054 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e1b7c059-88d3-48eb-b07b-3839e74681e9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:13.852831 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e1b7c059-88d3-48eb-b07b-3839e74681e9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:13.853258 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e1b7c059-88d3-48eb-b07b-3839e74681e9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:14.153149 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e1b7c059-88d3-48eb-b07b-3839e74681e9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:14.160334 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e1b7c059-88d3-48eb-b07b-3839e74681e9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.319334 May 17 12:07:14.160927 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 77/134] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:13 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:14.345287 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6e3dab42-c8de-4ac8-b91e-d48da18c5890 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:14.346191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6e3dab42-c8de-4ac8-b91e-d48da18c5890 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:14.353599 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6e3dab42-c8de-4ac8-b91e-d48da18c5890 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:14.354127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6e3dab42-c8de-4ac8-b91e-d48da18c5890 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:14.355104 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6e3dab42-c8de-4ac8-b91e-d48da18c5890 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:14.355607 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6e3dab42-c8de-4ac8-b91e-d48da18c5890 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:14.486198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6e3dab42-c8de-4ac8-b91e-d48da18c5890 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:14.500652 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6e3dab42-c8de-4ac8-b91e-d48da18c5890 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.159564 May 17 12:07:14.501566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 58/135] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:14 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:14.717773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bb3a0fcb-083f-4490-a3ba-a0f3a77a6fb1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:14.718395 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bb3a0fcb-083f-4490-a3ba-a0f3a77a6fb1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:14.724162 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bb3a0fcb-083f-4490-a3ba-a0f3a77a6fb1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:14.724640 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bb3a0fcb-083f-4490-a3ba-a0f3a77a6fb1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:14.725409 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bb3a0fcb-083f-4490-a3ba-a0f3a77a6fb1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:14.725846 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bb3a0fcb-083f-4490-a3ba-a0f3a77a6fb1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:14.746791 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1f5b235e-5712-4255-9761-bbaef0755662 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:14.747982 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1f5b235e-5712-4255-9761-bbaef0755662 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:14.757075 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f5b235e-5712-4255-9761-bbaef0755662 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:14.757529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f5b235e-5712-4255-9761-bbaef0755662 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:14.759121 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f5b235e-5712-4255-9761-bbaef0755662 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:14.759707 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f5b235e-5712-4255-9761-bbaef0755662 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:14.869012 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bb3a0fcb-083f-4490-a3ba-a0f3a77a6fb1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:14.876765 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bb3a0fcb-083f-4490-a3ba-a0f3a77a6fb1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.162765 May 17 12:07:14.877344 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 78/136] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:14 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:14.897763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1f5b235e-5712-4255-9761-bbaef0755662 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:14.906025 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1f5b235e-5712-4255-9761-bbaef0755662 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:14.907526 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1f5b235e-5712-4255-9761-bbaef0755662 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:14.908823 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1f5b235e-5712-4255-9761-bbaef0755662 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.166762 May 17 12:07:14.909382 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 59/137] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:14 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:07:15.177725 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d74eac4e-91e5-43fd-b5c9-97fd3b3db7df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:15.178416 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d74eac4e-91e5-43fd-b5c9-97fd3b3db7df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:15.184812 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d74eac4e-91e5-43fd-b5c9-97fd3b3db7df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:15.185259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d74eac4e-91e5-43fd-b5c9-97fd3b3db7df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:15.186022 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d74eac4e-91e5-43fd-b5c9-97fd3b3db7df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:15.186461 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d74eac4e-91e5-43fd-b5c9-97fd3b3db7df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:15.324865 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d74eac4e-91e5-43fd-b5c9-97fd3b3db7df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:15.332323 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d74eac4e-91e5-43fd-b5c9-97fd3b3db7df tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.158426 May 17 12:07:15.332918 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 79/138] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:15 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:15.517771 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2555ebd5-ab17-47fb-8b54-54f9b0929e2e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:15.518409 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2555ebd5-ab17-47fb-8b54-54f9b0929e2e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:15.525463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2555ebd5-ab17-47fb-8b54-54f9b0929e2e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:15.525922 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2555ebd5-ab17-47fb-8b54-54f9b0929e2e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:15.526691 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2555ebd5-ab17-47fb-8b54-54f9b0929e2e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:15.527125 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2555ebd5-ab17-47fb-8b54-54f9b0929e2e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:15.687112 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2555ebd5-ab17-47fb-8b54-54f9b0929e2e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:15.695158 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2555ebd5-ab17-47fb-8b54-54f9b0929e2e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1322 microversion: 2.1 time: 0.180150 May 17 12:07:15.696768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 60/139] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:15 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:15.893833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-74825688-e213-4395-9200-5b65443313b3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:15.894370 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-74825688-e213-4395-9200-5b65443313b3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:15.901039 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-74825688-e213-4395-9200-5b65443313b3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:15.901538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-74825688-e213-4395-9200-5b65443313b3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:15.902300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-74825688-e213-4395-9200-5b65443313b3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:15.902757 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-74825688-e213-4395-9200-5b65443313b3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:15.930591 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c586ed2d-3968-4cb4-a1bb-b734c736b0a2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:15.931797 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c586ed2d-3968-4cb4-a1bb-b734c736b0a2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:15.938265 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c586ed2d-3968-4cb4-a1bb-b734c736b0a2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:15.938721 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c586ed2d-3968-4cb4-a1bb-b734c736b0a2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:15.939503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c586ed2d-3968-4cb4-a1bb-b734c736b0a2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:15.939947 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c586ed2d-3968-4cb4-a1bb-b734c736b0a2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:16.028153 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-74825688-e213-4395-9200-5b65443313b3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:16.035425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-74825688-e213-4395-9200-5b65443313b3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.145555 May 17 12:07:16.035996 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 80/140] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:15 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:16.072400 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c586ed2d-3968-4cb4-a1bb-b734c736b0a2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:16.080282 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c586ed2d-3968-4cb4-a1bb-b734c736b0a2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:16.081802 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c586ed2d-3968-4cb4-a1bb-b734c736b0a2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:16.082921 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c586ed2d-3968-4cb4-a1bb-b734c736b0a2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.159763 May 17 12:07:16.083469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 61/141] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:15 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:07:16.349259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-111c33dd-0ca8-4cee-b0cf-62bbfa61fb4a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:16.349871 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-111c33dd-0ca8-4cee-b0cf-62bbfa61fb4a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:16.355742 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-111c33dd-0ca8-4cee-b0cf-62bbfa61fb4a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:16.356216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-111c33dd-0ca8-4cee-b0cf-62bbfa61fb4a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:16.356989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-111c33dd-0ca8-4cee-b0cf-62bbfa61fb4a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:16.357426 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-111c33dd-0ca8-4cee-b0cf-62bbfa61fb4a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:16.486293 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-111c33dd-0ca8-4cee-b0cf-62bbfa61fb4a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:16.494393 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-111c33dd-0ca8-4cee-b0cf-62bbfa61fb4a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.148950 May 17 12:07:16.494999 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 81/142] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:16 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:16.712503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-345da9c8-95d6-48e2-8658-7d6201266aca tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:16.713120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-345da9c8-95d6-48e2-8658-7d6201266aca tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:16.720716 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-345da9c8-95d6-48e2-8658-7d6201266aca tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:16.720716 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-345da9c8-95d6-48e2-8658-7d6201266aca tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:16.721115 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-345da9c8-95d6-48e2-8658-7d6201266aca tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:16.721397 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-345da9c8-95d6-48e2-8658-7d6201266aca tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:16.865468 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-345da9c8-95d6-48e2-8658-7d6201266aca tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:16.874178 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-345da9c8-95d6-48e2-8658-7d6201266aca tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1517 microversion: 2.1 time: 0.165591 May 17 12:07:16.874794 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 62/143] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:16 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:16.894874 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ed2a4c25-1d57-4242-868e-2a7ea06bc273 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:16.896311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ed2a4c25-1d57-4242-868e-2a7ea06bc273 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:16.904815 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ed2a4c25-1d57-4242-868e-2a7ea06bc273 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:16.905332 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ed2a4c25-1d57-4242-868e-2a7ea06bc273 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:16.910524 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ed2a4c25-1d57-4242-868e-2a7ea06bc273 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:16.910524 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ed2a4c25-1d57-4242-868e-2a7ea06bc273 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:16.987940 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.objects.instance [None req-ed2a4c25-1d57-4242-868e-2a7ea06bc273 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lazy-loading 'flavor' on Instance uuid 3493dcda-ee1b-44a0-9bcf-e873bb341e4c {{(pid=117114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:07:17.053135 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c922873a-5e7d-431f-a3df-b82559f8248a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:17.054388 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c922873a-5e7d-431f-a3df-b82559f8248a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:17.060793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c922873a-5e7d-431f-a3df-b82559f8248a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:17.061502 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c922873a-5e7d-431f-a3df-b82559f8248a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:17.062511 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c922873a-5e7d-431f-a3df-b82559f8248a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:17.062986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c922873a-5e7d-431f-a3df-b82559f8248a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:17.113953 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ed2a4c25-1d57-4242-868e-2a7ea06bc273 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c/action" status: 200 len: 32 microversion: 2.1 time: 0.224990 May 17 12:07:17.115003 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 82/144] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:07:16 2022] POST /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 12:07:17.121419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1f4b44bb-5d2b-4d5b-b55f-c4ec422770f3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:17.122224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1f4b44bb-5d2b-4d5b-b55f-c4ec422770f3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:17.128840 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1f4b44bb-5d2b-4d5b-b55f-c4ec422770f3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:17.129272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1f4b44bb-5d2b-4d5b-b55f-c4ec422770f3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:17.130073 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1f4b44bb-5d2b-4d5b-b55f-c4ec422770f3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:17.132364 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1f4b44bb-5d2b-4d5b-b55f-c4ec422770f3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:17.250204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c922873a-5e7d-431f-a3df-b82559f8248a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:17.260325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c922873a-5e7d-431f-a3df-b82559f8248a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.211394 May 17 12:07:17.261179 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 63/145] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:17 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:17.267104 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fb3cf823-a6dc-45c1-951e-32e81f203094 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:17.268094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fb3cf823-a6dc-45c1-951e-32e81f203094 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:17.278049 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb3cf823-a6dc-45c1-951e-32e81f203094 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:17.278502 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb3cf823-a6dc-45c1-951e-32e81f203094 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:17.279277 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb3cf823-a6dc-45c1-951e-32e81f203094 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:17.279717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb3cf823-a6dc-45c1-951e-32e81f203094 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:17.322860 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1f4b44bb-5d2b-4d5b-b55f-c4ec422770f3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:17.331629 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1f4b44bb-5d2b-4d5b-b55f-c4ec422770f3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:17.333193 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1f4b44bb-5d2b-4d5b-b55f-c4ec422770f3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:17.334583 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1f4b44bb-5d2b-4d5b-b55f-c4ec422770f3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.218225 May 17 12:07:17.340362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 83/146] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:17 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:07:17.424834 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-fb3cf823-a6dc-45c1-951e-32e81f203094 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:17.432305 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fb3cf823-a6dc-45c1-951e-32e81f203094 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.169757 May 17 12:07:17.432892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 64/147] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:17 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:17.512048 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1dcc0560-355e-4ae5-8906-312e02d3ea35 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:17.512887 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1dcc0560-355e-4ae5-8906-312e02d3ea35 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:17.518808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1dcc0560-355e-4ae5-8906-312e02d3ea35 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:17.519251 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1dcc0560-355e-4ae5-8906-312e02d3ea35 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:17.520005 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1dcc0560-355e-4ae5-8906-312e02d3ea35 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:17.520462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1dcc0560-355e-4ae5-8906-312e02d3ea35 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:17.653582 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1dcc0560-355e-4ae5-8906-312e02d3ea35 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:17.661254 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1dcc0560-355e-4ae5-8906-312e02d3ea35 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.153552 May 17 12:07:17.670385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 84/148] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:17 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:18.277129 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-08d21faa-515f-41d1-b4ad-7d04b72674cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:18.277828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-08d21faa-515f-41d1-b4ad-7d04b72674cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:18.284440 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08d21faa-515f-41d1-b4ad-7d04b72674cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:18.284860 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08d21faa-515f-41d1-b4ad-7d04b72674cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:18.285733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08d21faa-515f-41d1-b4ad-7d04b72674cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:18.286235 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08d21faa-515f-41d1-b4ad-7d04b72674cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:18.354758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-504d098c-25a8-4fda-832b-318b432b4df2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:18.355475 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-504d098c-25a8-4fda-832b-318b432b4df2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:18.361737 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-504d098c-25a8-4fda-832b-318b432b4df2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:18.362189 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-504d098c-25a8-4fda-832b-318b432b4df2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:18.362964 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-504d098c-25a8-4fda-832b-318b432b4df2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:18.363398 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-504d098c-25a8-4fda-832b-318b432b4df2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:18.419429 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-08d21faa-515f-41d1-b4ad-7d04b72674cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:18.426979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-08d21faa-515f-41d1-b4ad-7d04b72674cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.154286 May 17 12:07:18.427554 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 65/149] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:18 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:18.449740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ae6ab09f-e677-488b-9f84-cd0eefef3b84 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:18.450349 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ae6ab09f-e677-488b-9f84-cd0eefef3b84 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:18.456857 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ae6ab09f-e677-488b-9f84-cd0eefef3b84 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:18.457352 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ae6ab09f-e677-488b-9f84-cd0eefef3b84 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:18.458135 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ae6ab09f-e677-488b-9f84-cd0eefef3b84 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:18.458563 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ae6ab09f-e677-488b-9f84-cd0eefef3b84 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:18.496773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-504d098c-25a8-4fda-832b-318b432b4df2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:18.504810 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-504d098c-25a8-4fda-832b-318b432b4df2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:18.506310 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-504d098c-25a8-4fda-832b-318b432b4df2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:18.507398 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-504d098c-25a8-4fda-832b-318b432b4df2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.157651 May 17 12:07:18.508093 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 85/150] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:18 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:07:18.589173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ae6ab09f-e677-488b-9f84-cd0eefef3b84 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:18.596712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ae6ab09f-e677-488b-9f84-cd0eefef3b84 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.150810 May 17 12:07:18.597396 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 66/151] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:18 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:18.678135 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3ac1ddc8-8fdb-4172-9e8b-c86d7e97948e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:18.678740 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3ac1ddc8-8fdb-4172-9e8b-c86d7e97948e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:18.684796 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3ac1ddc8-8fdb-4172-9e8b-c86d7e97948e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:18.685267 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3ac1ddc8-8fdb-4172-9e8b-c86d7e97948e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:18.686028 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3ac1ddc8-8fdb-4172-9e8b-c86d7e97948e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:18.686463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3ac1ddc8-8fdb-4172-9e8b-c86d7e97948e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:18.820209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3ac1ddc8-8fdb-4172-9e8b-c86d7e97948e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:18.828231 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3ac1ddc8-8fdb-4172-9e8b-c86d7e97948e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.153962 May 17 12:07:18.828811 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 86/152] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:18 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:19.447598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-519ed85c-bc35-4070-aec4-ddf57289c035 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:19.448803 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-519ed85c-bc35-4070-aec4-ddf57289c035 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:19.455797 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-519ed85c-bc35-4070-aec4-ddf57289c035 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:19.456703 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-519ed85c-bc35-4070-aec4-ddf57289c035 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:19.457634 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-519ed85c-bc35-4070-aec4-ddf57289c035 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:19.458073 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-519ed85c-bc35-4070-aec4-ddf57289c035 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:19.532895 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a09c8ff3-61d5-4ceb-ac10-9984349e59ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:19.542255 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a09c8ff3-61d5-4ceb-ac10-9984349e59ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:19.551259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a09c8ff3-61d5-4ceb-ac10-9984349e59ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:19.552162 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a09c8ff3-61d5-4ceb-ac10-9984349e59ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:19.553266 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a09c8ff3-61d5-4ceb-ac10-9984349e59ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:19.554021 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a09c8ff3-61d5-4ceb-ac10-9984349e59ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:19.661357 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-519ed85c-bc35-4070-aec4-ddf57289c035 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:19.682157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-519ed85c-bc35-4070-aec4-ddf57289c035 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.240201 May 17 12:07:19.682703 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 67/153] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:19 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:19.691539 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-798d96fc-5d76-4385-a6aa-e6f501472f49 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:19.692442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-798d96fc-5d76-4385-a6aa-e6f501472f49 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:19.704283 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-798d96fc-5d76-4385-a6aa-e6f501472f49 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:19.705464 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-798d96fc-5d76-4385-a6aa-e6f501472f49 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:19.707234 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-798d96fc-5d76-4385-a6aa-e6f501472f49 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:19.708717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-798d96fc-5d76-4385-a6aa-e6f501472f49 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:19.781574 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a09c8ff3-61d5-4ceb-ac10-9984349e59ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:19.791362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a09c8ff3-61d5-4ceb-ac10-9984349e59ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:19.793573 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a09c8ff3-61d5-4ceb-ac10-9984349e59ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:19.795118 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a09c8ff3-61d5-4ceb-ac10-9984349e59ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.273664 May 17 12:07:19.802968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 87/154] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:19 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:07:19.847066 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c73358c8-f067-4f78-9fda-458a24f822bb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:19.852282 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c73358c8-f067-4f78-9fda-458a24f822bb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:19.858677 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c73358c8-f067-4f78-9fda-458a24f822bb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:19.859127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c73358c8-f067-4f78-9fda-458a24f822bb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:19.859895 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c73358c8-f067-4f78-9fda-458a24f822bb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:19.860665 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c73358c8-f067-4f78-9fda-458a24f822bb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:19.922123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-798d96fc-5d76-4385-a6aa-e6f501472f49 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:19.933262 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-798d96fc-5d76-4385-a6aa-e6f501472f49 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.247436 May 17 12:07:19.934318 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 68/155] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:19 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:20.055758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c73358c8-f067-4f78-9fda-458a24f822bb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:20.063604 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c73358c8-f067-4f78-9fda-458a24f822bb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.221768 May 17 12:07:20.064190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 88/156] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:19 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:20.699986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e2999f24-dc90-4602-9ac6-0ec287602e04 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:20.701356 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e2999f24-dc90-4602-9ac6-0ec287602e04 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:20.708045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e2999f24-dc90-4602-9ac6-0ec287602e04 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:20.709505 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e2999f24-dc90-4602-9ac6-0ec287602e04 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:20.711898 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e2999f24-dc90-4602-9ac6-0ec287602e04 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:20.712426 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e2999f24-dc90-4602-9ac6-0ec287602e04 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:20.821857 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0cc9835b-20c0-4997-8a7a-314ad08a2bc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:20.822573 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0cc9835b-20c0-4997-8a7a-314ad08a2bc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:20.828777 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0cc9835b-20c0-4997-8a7a-314ad08a2bc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:20.829297 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0cc9835b-20c0-4997-8a7a-314ad08a2bc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:20.830294 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0cc9835b-20c0-4997-8a7a-314ad08a2bc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:20.831028 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0cc9835b-20c0-4997-8a7a-314ad08a2bc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:20.879211 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e2999f24-dc90-4602-9ac6-0ec287602e04 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:20.888958 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e2999f24-dc90-4602-9ac6-0ec287602e04 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.193632 May 17 12:07:20.889668 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 69/157] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:20 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:20.952136 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5f99199b-02d4-4636-a735-15a4a190d426 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:20.952785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5f99199b-02d4-4636-a735-15a4a190d426 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:20.960168 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5f99199b-02d4-4636-a735-15a4a190d426 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:20.961937 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5f99199b-02d4-4636-a735-15a4a190d426 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:20.963290 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5f99199b-02d4-4636-a735-15a4a190d426 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:20.963964 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5f99199b-02d4-4636-a735-15a4a190d426 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:21.025630 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0cc9835b-20c0-4997-8a7a-314ad08a2bc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:21.034418 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0cc9835b-20c0-4997-8a7a-314ad08a2bc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:21.036650 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0cc9835b-20c0-4997-8a7a-314ad08a2bc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:21.037952 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0cc9835b-20c0-4997-8a7a-314ad08a2bc8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.221248 May 17 12:07:21.049090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 89/158] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:20 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:07:21.081466 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3079ec10-42ba-490d-bf1f-283972f0c76c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:21.082478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3079ec10-42ba-490d-bf1f-283972f0c76c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:21.091163 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3079ec10-42ba-490d-bf1f-283972f0c76c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:21.091961 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3079ec10-42ba-490d-bf1f-283972f0c76c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:21.093071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3079ec10-42ba-490d-bf1f-283972f0c76c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:21.093820 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3079ec10-42ba-490d-bf1f-283972f0c76c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:21.133354 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5f99199b-02d4-4636-a735-15a4a190d426 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:21.143117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5f99199b-02d4-4636-a735-15a4a190d426 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.194839 May 17 12:07:21.144031 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 70/159] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:20 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:21.225925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-1506f8bb-c6db-44bd-8e4f-ab03b1884f8e req-22fc8682-34a2-4255-b9cd-3a0aa97b38ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed125da4-128c-4d7e-ae52-d42f71475d0d", "name": "network-vif-plugged", "status": "completed", "tag": "e9c1c53c-8160-4739-98f3-05a522031fb3"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:21.239452 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-1506f8bb-c6db-44bd-8e4f-ab03b1884f8e req-22fc8682-34a2-4255-b9cd-3a0aa97b38ef service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:21.239997 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-1506f8bb-c6db-44bd-8e4f-ab03b1884f8e req-22fc8682-34a2-4255-b9cd-3a0aa97b38ef service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:21.253362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-1506f8bb-c6db-44bd-8e4f-ab03b1884f8e req-22fc8682-34a2-4255-b9cd-3a0aa97b38ef service nova] Creating event network-vif-plugged:e9c1c53c-8160-4739-98f3-05a522031fb3 for instance ed125da4-128c-4d7e-ae52-d42f71475d0d on hv-cinder-83769 May 17 12:07:21.264601 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-1506f8bb-c6db-44bd-8e4f-ab03b1884f8e req-22fc8682-34a2-4255-b9cd-3a0aa97b38ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046820 May 17 12:07:21.265681 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 71/160] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:07:21.332578 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3079ec10-42ba-490d-bf1f-283972f0c76c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:21.341580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3079ec10-42ba-490d-bf1f-283972f0c76c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.264106 May 17 12:07:21.342413 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 90/161] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:21 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:21.907508 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6d15409c-31ca-45ce-932a-ba0771cbcdcb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:21.908062 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6d15409c-31ca-45ce-932a-ba0771cbcdcb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:21.915232 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6d15409c-31ca-45ce-932a-ba0771cbcdcb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:21.915683 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6d15409c-31ca-45ce-932a-ba0771cbcdcb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:21.916520 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6d15409c-31ca-45ce-932a-ba0771cbcdcb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:21.916962 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6d15409c-31ca-45ce-932a-ba0771cbcdcb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.060060 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cea942b7-fac2-4de5-9c61-7b1073a7edf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:22.062097 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cea942b7-fac2-4de5-9c61-7b1073a7edf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:22.070929 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cea942b7-fac2-4de5-9c61-7b1073a7edf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:22.071461 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cea942b7-fac2-4de5-9c61-7b1073a7edf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.073221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cea942b7-fac2-4de5-9c61-7b1073a7edf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:22.073664 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cea942b7-fac2-4de5-9c61-7b1073a7edf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.119200 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6d15409c-31ca-45ce-932a-ba0771cbcdcb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:22.127583 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6d15409c-31ca-45ce-932a-ba0771cbcdcb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.224786 May 17 12:07:22.128390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 72/162] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:21 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:22.165511 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-069a6351-e4c0-424f-a333-8d563448a24a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:22.166131 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-069a6351-e4c0-424f-a333-8d563448a24a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:22.172578 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-069a6351-e4c0-424f-a333-8d563448a24a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:22.173039 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-069a6351-e4c0-424f-a333-8d563448a24a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.173809 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-069a6351-e4c0-424f-a333-8d563448a24a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:22.174259 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-069a6351-e4c0-424f-a333-8d563448a24a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.256265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cea942b7-fac2-4de5-9c61-7b1073a7edf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:22.270866 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cea942b7-fac2-4de5-9c61-7b1073a7edf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:22.274450 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cea942b7-fac2-4de5-9c61-7b1073a7edf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:22.276576 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cea942b7-fac2-4de5-9c61-7b1073a7edf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1407 microversion: 2.20 time: 0.223723 May 17 12:07:22.277927 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 91/163] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:22 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:07:22.359590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6aa6e8ed-2303-418e-83c9-856424c562a4 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:22.360545 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6aa6e8ed-2303-418e-83c9-856424c562a4 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:22.362257 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-069a6351-e4c0-424f-a333-8d563448a24a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:22.373472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-069a6351-e4c0-424f-a333-8d563448a24a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.209387 May 17 12:07:22.374420 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 73/164] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:22 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:22.392661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6aa6e8ed-2303-418e-83c9-856424c562a4 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:22.393328 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6aa6e8ed-2303-418e-83c9-856424c562a4 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.396838 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6aa6e8ed-2303-418e-83c9-856424c562a4 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:22.401388 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6aa6e8ed-2303-418e-83c9-856424c562a4 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.596433 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-db9eb01c-fec5-41ec-91a2-8a6d074b9c3a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:22.596433 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-db9eb01c-fec5-41ec-91a2-8a6d074b9c3a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:22.602874 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db9eb01c-fec5-41ec-91a2-8a6d074b9c3a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:22.603332 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db9eb01c-fec5-41ec-91a2-8a6d074b9c3a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.604359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db9eb01c-fec5-41ec-91a2-8a6d074b9c3a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:22.604980 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db9eb01c-fec5-41ec-91a2-8a6d074b9c3a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.636260 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-db9eb01c-fec5-41ec-91a2-8a6d074b9c3a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Going to try to terminate instance {{(pid=117113) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:07:22.692784 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6aa6e8ed-2303-418e-83c9-856424c562a4 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:22.703305 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6aa6e8ed-2303-418e-83c9-856424c562a4 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1362 microversion: 2.1 time: 0.348284 May 17 12:07:22.713520 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 92/165] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:22 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1362 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:22.766747 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-db9eb01c-fec5-41ec-91a2-8a6d074b9c3a tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "DELETE /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 204 len: 0 microversion: 2.1 time: 0.174924 May 17 12:07:22.767351 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 74/166] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:07:22 2022] DELETE /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:07:22.776790 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a767c111-a500-4d88-abd1-d4fd3092bf88 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:22.777676 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a767c111-a500-4d88-abd1-d4fd3092bf88 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:22.784063 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a767c111-a500-4d88-abd1-d4fd3092bf88 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:22.784798 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a767c111-a500-4d88-abd1-d4fd3092bf88 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.785803 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a767c111-a500-4d88-abd1-d4fd3092bf88 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:22.786470 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a767c111-a500-4d88-abd1-d4fd3092bf88 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:22.944881 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a767c111-a500-4d88-abd1-d4fd3092bf88 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:22.954051 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a767c111-a500-4d88-abd1-d4fd3092bf88 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1553 microversion: 2.1 time: 0.181503 May 17 12:07:22.954732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 93/167] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:22 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:23.144834 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5b8112b1-9b8e-4b1f-82ae-959d26b1a411 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:23.145537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5b8112b1-9b8e-4b1f-82ae-959d26b1a411 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:23.152950 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b8112b1-9b8e-4b1f-82ae-959d26b1a411 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.153560 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b8112b1-9b8e-4b1f-82ae-959d26b1a411 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.154471 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b8112b1-9b8e-4b1f-82ae-959d26b1a411 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.155362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b8112b1-9b8e-4b1f-82ae-959d26b1a411 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.295307 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-21707226-a78d-4eda-b7fa-00025cfaab16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:23.296640 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-21707226-a78d-4eda-b7fa-00025cfaab16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:23.303257 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-21707226-a78d-4eda-b7fa-00025cfaab16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.303713 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-21707226-a78d-4eda-b7fa-00025cfaab16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.305036 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-21707226-a78d-4eda-b7fa-00025cfaab16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.305527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-21707226-a78d-4eda-b7fa-00025cfaab16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.313404 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5b8112b1-9b8e-4b1f-82ae-959d26b1a411 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:23.322828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5b8112b1-9b8e-4b1f-82ae-959d26b1a411 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.182008 May 17 12:07:23.323622 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 75/168] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:23 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:23.390849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-94878bcd-9eab-46c2-8213-32bdfb198100 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:23.391462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-94878bcd-9eab-46c2-8213-32bdfb198100 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:23.397929 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-94878bcd-9eab-46c2-8213-32bdfb198100 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.398715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-94878bcd-9eab-46c2-8213-32bdfb198100 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.399638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-94878bcd-9eab-46c2-8213-32bdfb198100 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.400296 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-94878bcd-9eab-46c2-8213-32bdfb198100 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.450556 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-21707226-a78d-4eda-b7fa-00025cfaab16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:23.458659 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-21707226-a78d-4eda-b7fa-00025cfaab16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:23.460439 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-21707226-a78d-4eda-b7fa-00025cfaab16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:23.461689 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-21707226-a78d-4eda-b7fa-00025cfaab16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1598 microversion: 2.20 time: 0.170544 May 17 12:07:23.462258 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 94/169] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:07:23 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:07:23.480373 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9f569bd5-df35-46a2-98f1-cb6915e10d9d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:23.480872 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9f569bd5-df35-46a2-98f1-cb6915e10d9d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:23.486808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f569bd5-df35-46a2-98f1-cb6915e10d9d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.487256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f569bd5-df35-46a2-98f1-cb6915e10d9d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.488057 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f569bd5-df35-46a2-98f1-cb6915e10d9d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.488471 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f569bd5-df35-46a2-98f1-cb6915e10d9d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.562527 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-94878bcd-9eab-46c2-8213-32bdfb198100 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:23.571467 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-94878bcd-9eab-46c2-8213-32bdfb198100 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.184302 May 17 12:07:23.571993 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9f569bd5-df35-46a2-98f1-cb6915e10d9d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096034 May 17 12:07:23.572123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 76/170] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:23 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:23.573018 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 95/171] 10.222.0.58 () {60 vars in 1315 bytes} [Tue May 17 12:07:23 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 12:07:23.721339 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0fd6c633-7ccb-4533-8a70-c84786ead9f6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:23.722050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0fd6c633-7ccb-4533-8a70-c84786ead9f6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:23.728637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0fd6c633-7ccb-4533-8a70-c84786ead9f6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.729193 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0fd6c633-7ccb-4533-8a70-c84786ead9f6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.730048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0fd6c633-7ccb-4533-8a70-c84786ead9f6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.730552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0fd6c633-7ccb-4533-8a70-c84786ead9f6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.877326 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0fd6c633-7ccb-4533-8a70-c84786ead9f6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:23.885953 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0fd6c633-7ccb-4533-8a70-c84786ead9f6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1546 microversion: 2.1 time: 0.168620 May 17 12:07:23.887025 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 77/172] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:23 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:23.904103 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6461524c-7a50-4b03-b3ef-86e2152f6605 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:23.904637 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6461524c-7a50-4b03-b3ef-86e2152f6605 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:23.910493 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6461524c-7a50-4b03-b3ef-86e2152f6605 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.910940 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6461524c-7a50-4b03-b3ef-86e2152f6605 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.911745 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6461524c-7a50-4b03-b3ef-86e2152f6605 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.912199 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6461524c-7a50-4b03-b3ef-86e2152f6605 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.972995 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-28208af1-9ba1-48a2-9b47-b6e627334673 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:23.972995 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-28208af1-9ba1-48a2-9b47-b6e627334673 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:23.979441 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28208af1-9ba1-48a2-9b47-b6e627334673 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.979848 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28208af1-9ba1-48a2-9b47-b6e627334673 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:23.980784 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28208af1-9ba1-48a2-9b47-b6e627334673 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:23.981218 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28208af1-9ba1-48a2-9b47-b6e627334673 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:24.079329 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6461524c-7a50-4b03-b3ef-86e2152f6605 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178553 May 17 12:07:24.080802 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 96/173] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 17 12:07:23 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:24.302497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-28208af1-9ba1-48a2-9b47-b6e627334673 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:24.311701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-28208af1-9ba1-48a2-9b47-b6e627334673 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1553 microversion: 2.1 time: 0.343307 May 17 12:07:24.312665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 78/174] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:23 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1553 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:24.339691 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b926f39c-8088-4679-8efb-66648035508b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:24.340349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b926f39c-8088-4679-8efb-66648035508b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:24.351096 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b926f39c-8088-4679-8efb-66648035508b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:24.352974 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b926f39c-8088-4679-8efb-66648035508b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:24.354527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b926f39c-8088-4679-8efb-66648035508b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:24.355987 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b926f39c-8088-4679-8efb-66648035508b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:24.591045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8bff9309-8d21-46bc-a9ba-5e254301d4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:24.592301 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8bff9309-8d21-46bc-a9ba-5e254301d4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:24.600913 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bff9309-8d21-46bc-a9ba-5e254301d4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:24.603111 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bff9309-8d21-46bc-a9ba-5e254301d4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:24.604136 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bff9309-8d21-46bc-a9ba-5e254301d4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:24.605094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bff9309-8d21-46bc-a9ba-5e254301d4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:24.639854 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b926f39c-8088-4679-8efb-66648035508b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:24.650827 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b926f39c-8088-4679-8efb-66648035508b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.315527 May 17 12:07:24.653160 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 97/175] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:24 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:25.076990 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8bff9309-8d21-46bc-a9ba-5e254301d4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:25.089219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8bff9309-8d21-46bc-a9ba-5e254301d4c9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.504598 May 17 12:07:25.090783 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 79/176] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:24 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:25.185619 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-cbf0c875-2e9e-4ee0-bca9-4b481165fa82 req-06472ec6-3317-4ced-ad70-2dbda89b85c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d883f923-082e-4ee1-ba3e-0975ba2d7409", "tag": "cf6ad775-daff-4e4a-b3ee-b4652d53fdfe"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:25.216425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-cbf0c875-2e9e-4ee0-bca9-4b481165fa82 req-06472ec6-3317-4ced-ad70-2dbda89b85c6 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:25.217078 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-cbf0c875-2e9e-4ee0-bca9-4b481165fa82 req-06472ec6-3317-4ced-ad70-2dbda89b85c6 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:25.245576 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-cbf0c875-2e9e-4ee0-bca9-4b481165fa82 req-06472ec6-3317-4ced-ad70-2dbda89b85c6 service nova] Creating event network-changed:cf6ad775-daff-4e4a-b3ee-b4652d53fdfe for instance d883f923-082e-4ee1-ba3e-0975ba2d7409 on hv-cinder-83769 May 17 12:07:25.263322 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-cbf0c875-2e9e-4ee0-bca9-4b481165fa82 req-06472ec6-3317-4ced-ad70-2dbda89b85c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077444 May 17 12:07:25.264132 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 98/177] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:25.331506 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b527c732-54db-4648-8d03-f2f233e8339b tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:25.332411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b527c732-54db-4648-8d03-f2f233e8339b tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:25.339843 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b527c732-54db-4648-8d03-f2f233e8339b tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:25.340604 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b527c732-54db-4648-8d03-f2f233e8339b tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:25.341584 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b527c732-54db-4648-8d03-f2f233e8339b tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:25.342787 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b527c732-54db-4648-8d03-f2f233e8339b tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:25.673791 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9749f7a1-7770-44be-a0df-eb8f6cd3caa6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:25.675547 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9749f7a1-7770-44be-a0df-eb8f6cd3caa6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:25.689697 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9749f7a1-7770-44be-a0df-eb8f6cd3caa6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:25.690622 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9749f7a1-7770-44be-a0df-eb8f6cd3caa6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:25.691819 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9749f7a1-7770-44be-a0df-eb8f6cd3caa6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:25.692646 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9749f7a1-7770-44be-a0df-eb8f6cd3caa6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:25.763877 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b527c732-54db-4648-8d03-f2f233e8339b tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:25.776992 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b527c732-54db-4648-8d03-f2f233e8339b tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1553 microversion: 2.1 time: 0.449060 May 17 12:07:25.779157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 80/178] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:25 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1553 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:25.942904 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9749f7a1-7770-44be-a0df-eb8f6cd3caa6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:25.962755 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9749f7a1-7770-44be-a0df-eb8f6cd3caa6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.295109 May 17 12:07:25.964084 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 99/179] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:25 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:26.108845 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-692606f5-cbd7-4029-8db9-15b8e8a16414 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:26.109525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-692606f5-cbd7-4029-8db9-15b8e8a16414 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:26.140841 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-692606f5-cbd7-4029-8db9-15b8e8a16414 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:26.143078 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-692606f5-cbd7-4029-8db9-15b8e8a16414 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:26.145122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-7305229b-78ac-4e19-b7c8-d8dbe7d6ff8e req-4692a592-e478-42fa-83f7-b0562ee301f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7d37bf-7c1d-43d6-9ede-a2e330b5a043", "tag": "b58f565e-dd05-47fe-9192-f26d8c0f0286"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:26.146082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-692606f5-cbd7-4029-8db9-15b8e8a16414 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:26.146538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-692606f5-cbd7-4029-8db9-15b8e8a16414 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:26.168477 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-7305229b-78ac-4e19-b7c8-d8dbe7d6ff8e req-4692a592-e478-42fa-83f7-b0562ee301f0 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:26.171332 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-7305229b-78ac-4e19-b7c8-d8dbe7d6ff8e req-4692a592-e478-42fa-83f7-b0562ee301f0 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:26.197456 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-7305229b-78ac-4e19-b7c8-d8dbe7d6ff8e req-4692a592-e478-42fa-83f7-b0562ee301f0 service nova] Creating event network-changed:b58f565e-dd05-47fe-9192-f26d8c0f0286 for instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 on hv-cinder-83769 May 17 12:07:26.205127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-7305229b-78ac-4e19-b7c8-d8dbe7d6ff8e req-4692a592-e478-42fa-83f7-b0562ee301f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065205 May 17 12:07:26.206028 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 100/180] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:26.318021 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-692606f5-cbd7-4029-8db9-15b8e8a16414 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:26.336818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-692606f5-cbd7-4029-8db9-15b8e8a16414 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.233227 May 17 12:07:26.338199 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 81/181] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:26 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:26.795316 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cbd4d022-85bf-4085-9c2d-277bd5811472 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:26.796018 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cbd4d022-85bf-4085-9c2d-277bd5811472 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:26.803645 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cbd4d022-85bf-4085-9c2d-277bd5811472 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:26.804127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cbd4d022-85bf-4085-9c2d-277bd5811472 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:26.805828 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cbd4d022-85bf-4085-9c2d-277bd5811472 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:26.806205 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cbd4d022-85bf-4085-9c2d-277bd5811472 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:26.939270 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cbd4d022-85bf-4085-9c2d-277bd5811472 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:26.947619 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cbd4d022-85bf-4085-9c2d-277bd5811472 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1553 microversion: 2.1 time: 0.156480 May 17 12:07:26.948355 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 101/182] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:26 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:26.979405 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1321ae19-d213-4480-b505-3b7927a33fd7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:26.980027 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1321ae19-d213-4480-b505-3b7927a33fd7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:26.986367 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1321ae19-d213-4480-b505-3b7927a33fd7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:26.986835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1321ae19-d213-4480-b505-3b7927a33fd7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:26.987593 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1321ae19-d213-4480-b505-3b7927a33fd7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:26.988026 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1321ae19-d213-4480-b505-3b7927a33fd7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:27.131573 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1321ae19-d213-4480-b505-3b7927a33fd7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:27.139888 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1321ae19-d213-4480-b505-3b7927a33fd7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1367 microversion: 2.1 time: 0.165034 May 17 12:07:27.140485 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 82/183] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:26 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:27.353845 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4caed5c0-d7f8-416f-9552-8f281c9cbd11 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:27.354454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4caed5c0-d7f8-416f-9552-8f281c9cbd11 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:27.360567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4caed5c0-d7f8-416f-9552-8f281c9cbd11 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:27.361192 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4caed5c0-d7f8-416f-9552-8f281c9cbd11 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:27.361971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4caed5c0-d7f8-416f-9552-8f281c9cbd11 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:27.362411 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4caed5c0-d7f8-416f-9552-8f281c9cbd11 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:27.577573 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4caed5c0-d7f8-416f-9552-8f281c9cbd11 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:27.585008 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4caed5c0-d7f8-416f-9552-8f281c9cbd11 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.235130 May 17 12:07:27.585624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 102/184] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:27 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:27.964519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2bf6cde3-1d3d-43e5-8959-cc79df2da008 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:27.965138 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2bf6cde3-1d3d-43e5-8959-cc79df2da008 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:27.971020 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2bf6cde3-1d3d-43e5-8959-cc79df2da008 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:27.971472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2bf6cde3-1d3d-43e5-8959-cc79df2da008 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:27.972263 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2bf6cde3-1d3d-43e5-8959-cc79df2da008 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:27.972706 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2bf6cde3-1d3d-43e5-8959-cc79df2da008 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:28.110170 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2bf6cde3-1d3d-43e5-8959-cc79df2da008 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:28.127232 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2bf6cde3-1d3d-43e5-8959-cc79df2da008 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1553 microversion: 2.1 time: 0.159443 May 17 12:07:28.127232 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 83/185] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:27 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:28.156483 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6b43b4a3-854f-4d29-9b3d-c9bf1f28752e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:28.157094 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6b43b4a3-854f-4d29-9b3d-c9bf1f28752e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:28.162997 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b43b4a3-854f-4d29-9b3d-c9bf1f28752e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:28.163446 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b43b4a3-854f-4d29-9b3d-c9bf1f28752e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:28.164949 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b43b4a3-854f-4d29-9b3d-c9bf1f28752e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:28.165375 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b43b4a3-854f-4d29-9b3d-c9bf1f28752e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:28.294976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6b43b4a3-854f-4d29-9b3d-c9bf1f28752e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:28.302448 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6b43b4a3-854f-4d29-9b3d-c9bf1f28752e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1557 microversion: 2.1 time: 0.149742 May 17 12:07:28.303251 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 103/186] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:28 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:28.321455 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2686ffa5-344b-4e13-ae6c-84da7876998c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:28.321996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2686ffa5-344b-4e13-ae6c-84da7876998c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:28.328318 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2686ffa5-344b-4e13-ae6c-84da7876998c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:28.328773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2686ffa5-344b-4e13-ae6c-84da7876998c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:28.329714 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2686ffa5-344b-4e13-ae6c-84da7876998c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:28.330284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2686ffa5-344b-4e13-ae6c-84da7876998c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:28.421966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2686ffa5-344b-4e13-ae6c-84da7876998c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105048 May 17 12:07:28.422722 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 84/187] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 17 12:07:28 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:28.602033 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-24d1c916-2164-4594-8c94-ced4e130a015 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:28.602822 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-24d1c916-2164-4594-8c94-ced4e130a015 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:28.608741 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-24d1c916-2164-4594-8c94-ced4e130a015 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:28.609188 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-24d1c916-2164-4594-8c94-ced4e130a015 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:28.609952 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-24d1c916-2164-4594-8c94-ced4e130a015 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:28.610386 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-24d1c916-2164-4594-8c94-ced4e130a015 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:29.125074 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-24d1c916-2164-4594-8c94-ced4e130a015 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:29.137771 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-93407a6e-89db-4690-aac3-db5387bdb328 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:29.138930 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-93407a6e-89db-4690-aac3-db5387bdb328 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:29.151185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-24d1c916-2164-4594-8c94-ced4e130a015 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.552966 May 17 12:07:29.152919 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93407a6e-89db-4690-aac3-db5387bdb328 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:29.154594 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93407a6e-89db-4690-aac3-db5387bdb328 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:29.155155 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 104/188] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:28 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:29.156521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93407a6e-89db-4690-aac3-db5387bdb328 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:29.157148 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93407a6e-89db-4690-aac3-db5387bdb328 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:29.640470 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-93407a6e-89db-4690-aac3-db5387bdb328 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:29.653219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-93407a6e-89db-4690-aac3-db5387bdb328 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1553 microversion: 2.1 time: 0.520879 May 17 12:07:29.663460 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 85/189] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:29 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1553 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:29.790995 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-c57640cb-688d-482c-a6a5-39463f2af5de req-46336f4d-3634-44a7-bf80-09096729e0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "120ebbd5-b659-4429-aae8-830d4b1f06d1", "name": "network-vif-deleted", "tag": "2d56cb05-0c73-4387-b334-1a1670e55477"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:29.792584 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-3eda1864-a5ba-4630-9f61-282550c90a7c req-c9746841-40f4-49b6-994e-88dc8761b292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed125da4-128c-4d7e-ae52-d42f71475d0d", "tag": "e9c1c53c-8160-4739-98f3-05a522031fb3"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:29.799551 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-c57640cb-688d-482c-a6a5-39463f2af5de req-46336f4d-3634-44a7-bf80-09096729e0d0 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:29.800299 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-c57640cb-688d-482c-a6a5-39463f2af5de req-46336f4d-3634-44a7-bf80-09096729e0d0 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:29.801339 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-3eda1864-a5ba-4630-9f61-282550c90a7c req-c9746841-40f4-49b6-994e-88dc8761b292 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:29.801790 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-3eda1864-a5ba-4630-9f61-282550c90a7c req-c9746841-40f4-49b6-994e-88dc8761b292 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:29.813921 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-3eda1864-a5ba-4630-9f61-282550c90a7c req-c9746841-40f4-49b6-994e-88dc8761b292 service nova] Creating event network-changed:e9c1c53c-8160-4739-98f3-05a522031fb3 for instance ed125da4-128c-4d7e-ae52-d42f71475d0d on hv-cinder-83769 May 17 12:07:29.820269 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-3eda1864-a5ba-4630-9f61-282550c90a7c req-c9746841-40f4-49b6-994e-88dc8761b292 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034686 May 17 12:07:29.821686 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 105/190] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:29.833065 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-c57640cb-688d-482c-a6a5-39463f2af5de req-46336f4d-3634-44a7-bf80-09096729e0d0 service nova] Creating event network-vif-deleted:2d56cb05-0c73-4387-b334-1a1670e55477 for instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 on hv-cinder-83769 May 17 12:07:29.839170 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-c57640cb-688d-482c-a6a5-39463f2af5de req-46336f4d-3634-44a7-bf80-09096729e0d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052454 May 17 12:07:29.839790 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 86/191] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:07:30.171390 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cf871534-fedf-40df-8530-a2d8ef4a71db tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:30.172093 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cf871534-fedf-40df-8530-a2d8ef4a71db tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:30.178027 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cf871534-fedf-40df-8530-a2d8ef4a71db tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:30.178470 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cf871534-fedf-40df-8530-a2d8ef4a71db tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:30.179301 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cf871534-fedf-40df-8530-a2d8ef4a71db tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:30.180487 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cf871534-fedf-40df-8530-a2d8ef4a71db tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:30.325980 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cf871534-fedf-40df-8530-a2d8ef4a71db tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:30.333328 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cf871534-fedf-40df-8530-a2d8ef4a71db tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.166110 May 17 12:07:30.333970 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 106/192] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:30 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:30.671523 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1365ffcf-f733-4480-882c-0ae5f7dcc698 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:30.673120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1365ffcf-f733-4480-882c-0ae5f7dcc698 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:30.686015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1365ffcf-f733-4480-882c-0ae5f7dcc698 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:30.686695 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1365ffcf-f733-4480-882c-0ae5f7dcc698 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:30.688425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1365ffcf-f733-4480-882c-0ae5f7dcc698 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:30.689165 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1365ffcf-f733-4480-882c-0ae5f7dcc698 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:30.789755 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1365ffcf-f733-4480-882c-0ae5f7dcc698 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c48fb9b327045ed9236bea1ef6cdd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672159344e2c4ecbb0b633aa9606a119', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:30.797857 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1365ffcf-f733-4480-882c-0ae5f7dcc698 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 200 len: 1345 microversion: 2.1 time: 0.131213 May 17 12:07:30.798764 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 87/193] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:30 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 1345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:31.350280 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c8527bbd-0af1-4dd2-846f-a599f6e27950 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:31.351025 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c8527bbd-0af1-4dd2-846f-a599f6e27950 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:31.356864 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c8527bbd-0af1-4dd2-846f-a599f6e27950 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:31.357575 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c8527bbd-0af1-4dd2-846f-a599f6e27950 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:31.358475 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c8527bbd-0af1-4dd2-846f-a599f6e27950 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:31.358982 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c8527bbd-0af1-4dd2-846f-a599f6e27950 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:31.485949 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c8527bbd-0af1-4dd2-846f-a599f6e27950 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:31.493986 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c8527bbd-0af1-4dd2-846f-a599f6e27950 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.147500 May 17 12:07:31.494543 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 107/194] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:31 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:31.814708 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1cd6399e-fa37-41aa-b4e3-ce290aa0b266 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:31.815361 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1cd6399e-fa37-41aa-b4e3-ce290aa0b266 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:31.822382 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1cd6399e-fa37-41aa-b4e3-ce290aa0b266 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:31.822840 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1cd6399e-fa37-41aa-b4e3-ce290aa0b266 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:31.823621 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1cd6399e-fa37-41aa-b4e3-ce290aa0b266 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:31.824063 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1cd6399e-fa37-41aa-b4e3-ce290aa0b266 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:31.838986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-1cd6399e-fa37-41aa-b4e3-ce290aa0b266 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] HTTP exception thrown: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1cd6399e-fa37-41aa-b4e3-ce290aa0b266 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Request method failure captured: May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 HTTP/1.1 May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4-6qCz91mu0sSMtkWPBPd-uN7LzuRfP41TWfsCR2O7zzgXZt2eU-PjJ3VJxbNfvyflh_w2rdqmIyxMkZPL-cLjewv5fdtsIXAo_QTO8PR9nBpYM1NSgQDsojK_GrBpUd8OxBgWcHF169mhOhekLUH4FyL8TF1JKOl1MWeZNaFE0j7c May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 672159344e2c4ecbb0b633aa9606a119 May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-DeleteServersTestJSON-674804279 May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:07:31.843501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/672159344e2c4ecbb0b633aa9606a119"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_672159344e2c4ecbb0b633aa9606a119", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/672159344e2c4ecbb0b633aa9606a119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/672159344e2c4ecbb0b633aa9606a119"}]}] May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-DeleteServersTestJSON-674804279 May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 672159344e2c4ecbb0b633aa9606a119 May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-DeleteServersTestJSON-674804279 May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-DeleteServersTestJSON-674804279-project May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 2c48fb9b327045ed9236bea1ef6cdd73 May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-DeleteServersTestJSON-674804279-project May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:31.844933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '120ebbd5-b659-4429-aae8-830d4b1f06d1'} May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:07:31.845831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:31.847119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:31.848430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1cd6399e-fa37-41aa-b4e3-ce290aa0b266 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Returning 404 to user: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:07:31.848430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1cd6399e-fa37-41aa-b4e3-ce290aa0b266 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 404 len: 111 microversion: 2.1 time: 0.034111 May 17 12:07:31.848430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 88/195] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:31 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:07:31.949738 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8291dca0-11b9-4162-a597-7da60fa7d436 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:31.950667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8291dca0-11b9-4162-a597-7da60fa7d436 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:31.956421 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8291dca0-11b9-4162-a597-7da60fa7d436 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:31.956868 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8291dca0-11b9-4162-a597-7da60fa7d436 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:31.957623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8291dca0-11b9-4162-a597-7da60fa7d436 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:31.958090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8291dca0-11b9-4162-a597-7da60fa7d436 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:31.971535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-8291dca0-11b9-4162-a597-7da60fa7d436 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] HTTP exception thrown: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8291dca0-11b9-4162-a597-7da60fa7d436 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Request method failure captured: May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1/os-volume_attachments HTTP/1.1 May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4-6qCz91mu0sSMtkWPBPd-uN7LzuRfP41TWfsCR2O7zzgXZt2eU-PjJ3VJxbNfvyflh_w2rdqmIyxMkZPL-cLjewv5fdtsIXAo_QTO8PR9nBpYM1NSgQDsojK_GrBpUd8OxBgWcHF169mhOhekLUH4FyL8TF1JKOl1MWeZNaFE0j7c May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 672159344e2c4ecbb0b633aa9606a119 May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-DeleteServersTestJSON-674804279 May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:07:31.976867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/672159344e2c4ecbb0b633aa9606a119"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_672159344e2c4ecbb0b633aa9606a119", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/672159344e2c4ecbb0b633aa9606a119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/672159344e2c4ecbb0b633aa9606a119"}]}] May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-DeleteServersTestJSON-674804279 May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 672159344e2c4ecbb0b633aa9606a119 May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-DeleteServersTestJSON-674804279 May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-DeleteServersTestJSON-674804279-project May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 2c48fb9b327045ed9236bea1ef6cdd73 May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-DeleteServersTestJSON-674804279-project May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:31.978376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'server_id': '120ebbd5-b659-4429-aae8-830d4b1f06d1'} May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:07:31.979241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:31.980614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:31.981976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8291dca0-11b9-4162-a597-7da60fa7d436 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Returning 404 to user: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:07:31.981976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8291dca0-11b9-4162-a597-7da60fa7d436 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034309 May 17 12:07:31.981976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 108/196] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:07:31 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:07:32.510964 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fb5d8676-e8f5-4191-ba41-e3a081df2288 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:32.513952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fb5d8676-e8f5-4191-ba41-e3a081df2288 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:32.517805 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb5d8676-e8f5-4191-ba41-e3a081df2288 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:32.518194 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb5d8676-e8f5-4191-ba41-e3a081df2288 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:32.518968 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb5d8676-e8f5-4191-ba41-e3a081df2288 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:32.519410 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb5d8676-e8f5-4191-ba41-e3a081df2288 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:32.661176 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-fb5d8676-e8f5-4191-ba41-e3a081df2288 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:32.673909 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fb5d8676-e8f5-4191-ba41-e3a081df2288 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.167570 May 17 12:07:32.674491 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 89/197] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:32 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:33.691795 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1dabf836-8ffc-44d6-abf4-8bfd5e87617e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:33.692355 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1dabf836-8ffc-44d6-abf4-8bfd5e87617e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:33.698860 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1dabf836-8ffc-44d6-abf4-8bfd5e87617e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:33.699306 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1dabf836-8ffc-44d6-abf4-8bfd5e87617e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:33.700122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1dabf836-8ffc-44d6-abf4-8bfd5e87617e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:33.700710 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1dabf836-8ffc-44d6-abf4-8bfd5e87617e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:33.836292 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1dabf836-8ffc-44d6-abf4-8bfd5e87617e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:33.843554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1dabf836-8ffc-44d6-abf4-8bfd5e87617e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.155743 May 17 12:07:33.844217 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 109/198] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:33 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:34.225364 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-05e2d883-80ea-49ea-b74a-e97a0b640fe5 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:34.225872 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-05e2d883-80ea-49ea-b74a-e97a0b640fe5 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:34.233850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-05e2d883-80ea-49ea-b74a-e97a0b640fe5 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:34.234299 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-05e2d883-80ea-49ea-b74a-e97a0b640fe5 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:34.235080 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-05e2d883-80ea-49ea-b74a-e97a0b640fe5 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:34.235535 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-05e2d883-80ea-49ea-b74a-e97a0b640fe5 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:34.249570 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-05e2d883-80ea-49ea-b74a-e97a0b640fe5 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] HTTP exception thrown: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-05e2d883-80ea-49ea-b74a-e97a0b640fe5 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Request method failure captured: May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: DELETE /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 HTTP/1.1 May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4-6qCz91mu0sSMtkWPBPd-uN7LzuRfP41TWfsCR2O7zzgXZt2eU-PjJ3VJxbNfvyflh_w2rdqmIyxMkZPL-cLjewv5fdtsIXAo_QTO8PR9nBpYM1NSgQDsojK_GrBpUd8OxBgWcHF169mhOhekLUH4FyL8TF1JKOl1MWeZNaFE0j7c May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 672159344e2c4ecbb0b633aa9606a119 May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-DeleteServersTestJSON-674804279 May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:07:34.251090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/672159344e2c4ecbb0b633aa9606a119"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_672159344e2c4ecbb0b633aa9606a119", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/672159344e2c4ecbb0b633aa9606a119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/672159344e2c4ecbb0b633aa9606a119"}]}] May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-DeleteServersTestJSON-674804279 May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 672159344e2c4ecbb0b633aa9606a119 May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-DeleteServersTestJSON-674804279 May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-DeleteServersTestJSON-674804279-project May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 2c48fb9b327045ed9236bea1ef6cdd73 May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-DeleteServersTestJSON-674804279-project May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:34.252568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '120ebbd5-b659-4429-aae8-830d4b1f06d1'} May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:07:34.253453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:34.254835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:34.256354 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-05e2d883-80ea-49ea-b74a-e97a0b640fe5 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Returning 404 to user: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:07:34.256354 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-05e2d883-80ea-49ea-b74a-e97a0b640fe5 tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "DELETE /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 404 len: 111 microversion: 2.1 time: 0.031310 May 17 12:07:34.256354 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 90/199] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:07:34 2022] DELETE /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:07:34.261497 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5793f22e-3a84-48b1-8ef7-c6036ac312bf tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:34.262106 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5793f22e-3a84-48b1-8ef7-c6036ac312bf tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] [instance: 120ebbd5-b659-4429-aae8-830d4b1f06d1] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:34.268298 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5793f22e-3a84-48b1-8ef7-c6036ac312bf tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:34.268760 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5793f22e-3a84-48b1-8ef7-c6036ac312bf tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:34.269616 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5793f22e-3a84-48b1-8ef7-c6036ac312bf tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:34.270140 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5793f22e-3a84-48b1-8ef7-c6036ac312bf tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:34.283074 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-5793f22e-3a84-48b1-8ef7-c6036ac312bf tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] HTTP exception thrown: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5793f22e-3a84-48b1-8ef7-c6036ac312bf tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Request method failure captured: May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 HTTP/1.1 May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4-6qCz91mu0sSMtkWPBPd-uN7LzuRfP41TWfsCR2O7zzgXZt2eU-PjJ3VJxbNfvyflh_w2rdqmIyxMkZPL-cLjewv5fdtsIXAo_QTO8PR9nBpYM1NSgQDsojK_GrBpUd8OxBgWcHF169mhOhekLUH4FyL8TF1JKOl1MWeZNaFE0j7c May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 672159344e2c4ecbb0b633aa9606a119 May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-DeleteServersTestJSON-674804279 May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:07:34.285204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/672159344e2c4ecbb0b633aa9606a119"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_672159344e2c4ecbb0b633aa9606a119", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/672159344e2c4ecbb0b633aa9606a119"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/672159344e2c4ecbb0b633aa9606a119"}]}] May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-DeleteServersTestJSON-674804279 May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 672159344e2c4ecbb0b633aa9606a119 May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-DeleteServersTestJSON-674804279 May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-DeleteServersTestJSON-674804279-project May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 2c48fb9b327045ed9236bea1ef6cdd73 May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-DeleteServersTestJSON-674804279-project May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:34.286625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '120ebbd5-b659-4429-aae8-830d4b1f06d1'} May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:07:34.287560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. May 17 12:07:34.288775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:34.290256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5793f22e-3a84-48b1-8ef7-c6036ac312bf tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] Returning 404 to user: Instance 120ebbd5-b659-4429-aae8-830d4b1f06d1 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:07:34.290256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5793f22e-3a84-48b1-8ef7-c6036ac312bf tempest-DeleteServersTestJSON-674804279 tempest-DeleteServersTestJSON-674804279-project] 10.222.0.58 "GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1" status: 404 len: 111 microversion: 2.1 time: 0.029589 May 17 12:07:34.290256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 110/200] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:34 2022] GET /compute/v2.1/servers/120ebbd5-b659-4429-aae8-830d4b1f06d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:07:34.860971 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7e02cd55-476b-4871-8e52-165112036360 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:34.861599 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7e02cd55-476b-4871-8e52-165112036360 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:34.868035 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7e02cd55-476b-4871-8e52-165112036360 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:34.868529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7e02cd55-476b-4871-8e52-165112036360 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:34.869330 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7e02cd55-476b-4871-8e52-165112036360 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:34.869763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7e02cd55-476b-4871-8e52-165112036360 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:35.002656 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7e02cd55-476b-4871-8e52-165112036360 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:35.010683 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7e02cd55-476b-4871-8e52-165112036360 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.153621 May 17 12:07:35.011259 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 91/201] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:34 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:36.027193 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ae74804b-b9fd-4e7f-9068-234406e33899 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:36.027941 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ae74804b-b9fd-4e7f-9068-234406e33899 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:36.034335 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ae74804b-b9fd-4e7f-9068-234406e33899 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:36.034897 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ae74804b-b9fd-4e7f-9068-234406e33899 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:36.035771 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ae74804b-b9fd-4e7f-9068-234406e33899 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:36.036353 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ae74804b-b9fd-4e7f-9068-234406e33899 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:36.105663 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1f7159d5-1444-457b-86bd-a865f709fd6c tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Action: 'create', calling method: .version_select at 0x7f2db45260d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1131448664", "metadata": {"Type": "work"}}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1f7159d5-1444-457b-86bd-a865f709fd6c tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Request method failure captured: May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 122 May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig5AHotrRoSMOzR0CI3xuixFMq794cOheVmEQCPnjyQewsws4Rntyw6gfX8yeK8TKP_ZtrAetwF7a2BRuaPzft4SJKmjC3ilfcLdR6QyTxNdwEf210G3JC9TKEip-rITV9s7YeHi9hVKa8Mv2Q7iXnNmrd4MJ7nzKAwwl0slVkLxh2qU May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:07:36.115338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_995ad3f94a194c30a86a9c2b5b11935f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}] May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 79c9c9de0b974e2997c296d9fb555249 May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1131448664", "metadata": {"Type": "work"}}} May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: May 17 12:07:36.117449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1131448664', 'metadata': {'Type': 'work'}}}} May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise error May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi '#$%' May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:07:36.118309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 12:07:36.119503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 12:07:36.121170 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 12:07:36.121170 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.121170 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1f7159d5-1444-457b-86bd-a865f709fd6c tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:07:36.121170 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1f7159d5-1444-457b-86bd-a865f709fd6c tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.248643 May 17 12:07:36.124067 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 111/202] 10.222.0.58 () {60 vars in 1155 bytes} [Tue May 17 12:07:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 250 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 12:07:36.128934 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-81b25718-e6dd-4751-b850-cd3e556c453f tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Action: 'create', calling method: .version_select at 0x7f2db446a0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-594225508", "metadata": {"Type": "work"}}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-81b25718-e6dd-4751-b850-cd3e556c453f tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Request method failure captured: May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 119 May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig5AHotrRoSMOzR0CI3xuixFMq794cOheVmEQCPnjyQewsws4Rntyw6gfX8yeK8TKP_ZtrAetwF7a2BRuaPzft4SJKmjC3ilfcLdR6QyTxNdwEf210G3JC9TKEip-rITV9s7YeHi9hVKa8Mv2Q7iXnNmrd4MJ7nzKAwwl0slVkLxh2qU May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:07:36.132914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_995ad3f94a194c30a86a9c2b5b11935f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}] May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 79c9c9de0b974e2997c296d9fb555249 May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-594225508", "metadata": {"Type": "work"}}} May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: May 17 12:07:36.134366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-594225508', 'metadata': {'Type': 'work'}}}} May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise error May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi '0' May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:07:36.135296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 12:07:36.136990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 12:07:36.138079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 12:07:36.138079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.138079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-81b25718-e6dd-4751-b850-cd3e556c453f tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:07:36.138079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-81b25718-e6dd-4751-b850-cd3e556c453f tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009126 May 17 12:07:36.138079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 112/203] 10.222.0.58 () {60 vars in 1155 bytes} [Tue May 17 12:07:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 12:07:36.144408 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f6b1aa92-6357-48b1-b57e-b1712c014056 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Action: 'create', calling method: .version_select at 0x7f2db44d2160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-589175653", "metadata": {"Type": "work"}}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f6b1aa92-6357-48b1-b57e-b1712c014056 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Request method failure captured: May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 118 May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig5AHotrRoSMOzR0CI3xuixFMq794cOheVmEQCPnjyQewsws4Rntyw6gfX8yeK8TKP_ZtrAetwF7a2BRuaPzft4SJKmjC3ilfcLdR6QyTxNdwEf210G3JC9TKEip-rITV9s7YeHi9hVKa8Mv2Q7iXnNmrd4MJ7nzKAwwl0slVkLxh2qU May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:07:36.146670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_995ad3f94a194c30a86a9c2b5b11935f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}] May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 79c9c9de0b974e2997c296d9fb555249 May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-589175653", "metadata": {"Type": "work"}}} May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: May 17 12:07:36.148265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-589175653', 'metadata': {'Type': 'work'}}}} May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise error May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi '' May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:07:36.150164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 12:07:36.152369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 12:07:36.154587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 12:07:36.154587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.154587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f6b1aa92-6357-48b1-b57e-b1712c014056 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:07:36.154587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f6b1aa92-6357-48b1-b57e-b1712c014056 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007130 May 17 12:07:36.154587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 113/204] 10.222.0.58 () {60 vars in 1155 bytes} [Tue May 17 12:07:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 17 12:07:36.160248 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8fe3af82-b5e3-46bb-bfa6-ee98e00b3ff5 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Calling method '.version_select at 0x7f2db4526940>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:36.190353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-8fe3af82-b5e3-46bb-bfa6-ee98e00b3ff5 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] HTTP exception thrown: Volume tempest-invalid-1714534137 could not be found. May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8fe3af82-b5e3-46bb-bfa6-ee98e00b3ff5 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Request method failure captured: May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1714534137 HTTP/1.1 May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig5AHotrRoSMOzR0CI3xuixFMq794cOheVmEQCPnjyQewsws4Rntyw6gfX8yeK8TKP_ZtrAetwF7a2BRuaPzft4SJKmjC3ilfcLdR6QyTxNdwEf210G3JC9TKEip-rITV9s7YeHi9hVKa8Mv2Q7iXnNmrd4MJ7nzKAwwl0slVkLxh2qU May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:07:36.192362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_995ad3f94a194c30a86a9c2b5b11935f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}] May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 79c9c9de0b974e2997c296d9fb555249 May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Volume tempest-invalid-1714534137 could not be found. May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'tempest-invalid-1714534137'} May 17 12:07:36.193518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1714534137 could not be found. (HTTP 404) (Request-ID: req-9d054938-f263-4f77-9c6a-4bf54293e81f) May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.194216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 12:07:36.195544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1714534137 could not be found. May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:07:36.197944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1714534137 could not be found. May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1714534137 could not be found. May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8fe3af82-b5e3-46bb-bfa6-ee98e00b3ff5 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Returning 404 to user: Volume tempest-invalid-1714534137 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8fe3af82-b5e3-46bb-bfa6-ee98e00b3ff5 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1714534137" status: 404 len: 99 microversion: 2.1 time: 0.037152 May 17 12:07:36.200567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 114/205] 10.222.0.58 () {58 vars in 1217 bytes} [Tue May 17 12:07:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1714534137 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 17 12:07:36.202173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ae74804b-b9fd-4e7f-9068-234406e33899 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:36.205682 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cfb08505-698a-4fea-97bc-015b1ebdeb2b tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004235 May 17 12:07:36.208221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 115/206] 10.222.0.58 () {58 vars in 1139 bytes} [Tue May 17 12:07:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 17 12:07:36.208342 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ae74804b-b9fd-4e7f-9068-234406e33899 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.184256 May 17 12:07:36.208342 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 92/207] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:36 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:36.215189 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f01b0991-df67-420b-9a26-20717c810f2b tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003604 May 17 12:07:36.215681 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 116/208] 10.222.0.58 () {58 vars in 1136 bytes} [Tue May 17 12:07:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 17 12:07:36.224257 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-01099e10-da1e-48be-adfe-43d2d84e9256 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Calling method '.version_select at 0x7f2db44e4280>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:36.253758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-01099e10-da1e-48be-adfe-43d2d84e9256 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] HTTP exception thrown: Volume d36bf097-b984-4747-8927-55ac055325a0 could not be found. May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-01099e10-da1e-48be-adfe-43d2d84e9256 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Request method failure captured: May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: DELETE /compute/v2.1/os-volumes/d36bf097-b984-4747-8927-55ac055325a0 HTTP/1.1 May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig5AHotrRoSMOzR0CI3xuixFMq794cOheVmEQCPnjyQewsws4Rntyw6gfX8yeK8TKP_ZtrAetwF7a2BRuaPzft4SJKmjC3ilfcLdR6QyTxNdwEf210G3JC9TKEip-rITV9s7YeHi9hVKa8Mv2Q7iXnNmrd4MJ7nzKAwwl0slVkLxh2qU May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:07:36.255733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_995ad3f94a194c30a86a9c2b5b11935f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}] May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 79c9c9de0b974e2997c296d9fb555249 May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Volume d36bf097-b984-4747-8927-55ac055325a0 could not be found. May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'd36bf097-b984-4747-8927-55ac055325a0'} May 17 12:07:36.257143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d36bf097-b984-4747-8927-55ac055325a0 could not be found. (HTTP 404) (Request-ID: req-18468619-7f34-4d19-983e-537aefa63666) May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.258463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 12:07:36.260053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d36bf097-b984-4747-8927-55ac055325a0 could not be found. May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 12:07:36.261359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d36bf097-b984-4747-8927-55ac055325a0 could not be found. May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d36bf097-b984-4747-8927-55ac055325a0 could not be found. May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-01099e10-da1e-48be-adfe-43d2d84e9256 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Returning 404 to user: Volume d36bf097-b984-4747-8927-55ac055325a0 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-01099e10-da1e-48be-adfe-43d2d84e9256 tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/d36bf097-b984-4747-8927-55ac055325a0" status: 404 len: 109 microversion: 2.1 time: 0.037094 May 17 12:07:36.262359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 93/209] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 17 12:07:36 2022] DELETE /compute/v2.1/os-volumes/d36bf097-b984-4747-8927-55ac055325a0 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:07:36.268747 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-09fd15d2-5f0d-408b-88b6-90b40a2caada tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Calling method '.version_select at 0x7f2db44d2f70>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:36.296593 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-09fd15d2-5f0d-408b-88b6-90b40a2caada tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] HTTP exception thrown: Volume 51355de5-fbe5-4c16-afeb-c214881f8d1b could not be found. May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-09fd15d2-5f0d-408b-88b6-90b40a2caada tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Request method failure captured: May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/os-volumes/51355de5-fbe5-4c16-afeb-c214881f8d1b HTTP/1.1 May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig5AHotrRoSMOzR0CI3xuixFMq794cOheVmEQCPnjyQewsws4Rntyw6gfX8yeK8TKP_ZtrAetwF7a2BRuaPzft4SJKmjC3ilfcLdR6QyTxNdwEf210G3JC9TKEip-rITV9s7YeHi9hVKa8Mv2Q7iXnNmrd4MJ7nzKAwwl0slVkLxh2qU May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:07:36.298502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_995ad3f94a194c30a86a9c2b5b11935f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/995ad3f94a194c30a86a9c2b5b11935f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/995ad3f94a194c30a86a9c2b5b11935f"}]}] May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 995ad3f94a194c30a86a9c2b5b11935f May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-VolumesNegativeTest-2000448775 May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 79c9c9de0b974e2997c296d9fb555249 May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-VolumesNegativeTest-2000448775-project May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Volume 51355de5-fbe5-4c16-afeb-c214881f8d1b could not be found. May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '51355de5-fbe5-4c16-afeb-c214881f8d1b'} May 17 12:07:36.299669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51355de5-fbe5-4c16-afeb-c214881f8d1b could not be found. (HTTP 404) (Request-ID: req-bbc67d0f-3118-4738-b63a-a0d28db67b38) May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.300491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 12:07:36.301533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51355de5-fbe5-4c16-afeb-c214881f8d1b could not be found. May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 12:07:36.302627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51355de5-fbe5-4c16-afeb-c214881f8d1b could not be found. May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51355de5-fbe5-4c16-afeb-c214881f8d1b could not be found. May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-09fd15d2-5f0d-408b-88b6-90b40a2caada tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] Returning 404 to user: Volume 51355de5-fbe5-4c16-afeb-c214881f8d1b could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:07:36.303606 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-09fd15d2-5f0d-408b-88b6-90b40a2caada tempest-VolumesNegativeTest-2000448775 tempest-VolumesNegativeTest-2000448775-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/51355de5-fbe5-4c16-afeb-c214881f8d1b" status: 404 len: 109 microversion: 2.1 time: 0.035728 May 17 12:07:36.309596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 117/210] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:07:36 2022] GET /compute/v2.1/os-volumes/51355de5-fbe5-4c16-afeb-c214881f8d1b => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:07:37.225485 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b8c7b767-e962-4496-919a-85c161c1d200 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:37.226930 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b8c7b767-e962-4496-919a-85c161c1d200 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:37.237335 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b8c7b767-e962-4496-919a-85c161c1d200 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:37.237797 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b8c7b767-e962-4496-919a-85c161c1d200 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:37.238582 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b8c7b767-e962-4496-919a-85c161c1d200 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:37.239028 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b8c7b767-e962-4496-919a-85c161c1d200 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:37.373961 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b8c7b767-e962-4496-919a-85c161c1d200 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:37.381375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b8c7b767-e962-4496-919a-85c161c1d200 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.160092 May 17 12:07:37.381947 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 94/211] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:37 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:38.400809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-09213e38-7ad3-42a6-82d1-08f20caf168e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:38.402984 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-09213e38-7ad3-42a6-82d1-08f20caf168e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:38.415592 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-09213e38-7ad3-42a6-82d1-08f20caf168e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:38.415592 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-09213e38-7ad3-42a6-82d1-08f20caf168e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:38.415592 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-09213e38-7ad3-42a6-82d1-08f20caf168e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:38.415592 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-09213e38-7ad3-42a6-82d1-08f20caf168e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:38.544207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-09213e38-7ad3-42a6-82d1-08f20caf168e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:38.551598 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-09213e38-7ad3-42a6-82d1-08f20caf168e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.156519 May 17 12:07:38.552154 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 118/212] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:38 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:39.569122 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f9b8aace-7a4e-4299-b152-b985588a747f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:39.570270 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f9b8aace-7a4e-4299-b152-b985588a747f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:39.576791 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f9b8aace-7a4e-4299-b152-b985588a747f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:39.577235 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f9b8aace-7a4e-4299-b152-b985588a747f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:39.577999 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f9b8aace-7a4e-4299-b152-b985588a747f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:39.578430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f9b8aace-7a4e-4299-b152-b985588a747f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:39.706759 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f9b8aace-7a4e-4299-b152-b985588a747f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:39.714875 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f9b8aace-7a4e-4299-b152-b985588a747f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.149544 May 17 12:07:39.715444 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 95/213] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:39 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:40.732337 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-46300383-5e92-4503-bceb-8be3b79884b9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:40.732957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-46300383-5e92-4503-bceb-8be3b79884b9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:40.738820 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-46300383-5e92-4503-bceb-8be3b79884b9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:40.739272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-46300383-5e92-4503-bceb-8be3b79884b9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:40.740039 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-46300383-5e92-4503-bceb-8be3b79884b9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:40.740586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-46300383-5e92-4503-bceb-8be3b79884b9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:40.871926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-46300383-5e92-4503-bceb-8be3b79884b9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:40.879607 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-46300383-5e92-4503-bceb-8be3b79884b9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.151111 May 17 12:07:40.880288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 119/214] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:40 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:41.897172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ab0f633a-7a28-4f40-b532-16e5dddc9fff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:41.898451 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ab0f633a-7a28-4f40-b532-16e5dddc9fff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:41.904951 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab0f633a-7a28-4f40-b532-16e5dddc9fff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:41.905410 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab0f633a-7a28-4f40-b532-16e5dddc9fff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:41.906193 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab0f633a-7a28-4f40-b532-16e5dddc9fff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:41.906637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab0f633a-7a28-4f40-b532-16e5dddc9fff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:42.056338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ab0f633a-7a28-4f40-b532-16e5dddc9fff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:42.064889 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ab0f633a-7a28-4f40-b532-16e5dddc9fff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.171720 May 17 12:07:42.065830 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 96/215] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:41 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:43.083023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-76631129-2fac-4167-84a0-f247ad03ecfb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:43.083638 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-76631129-2fac-4167-84a0-f247ad03ecfb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:43.096512 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-76631129-2fac-4167-84a0-f247ad03ecfb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:43.096969 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-76631129-2fac-4167-84a0-f247ad03ecfb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:43.097748 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-76631129-2fac-4167-84a0-f247ad03ecfb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:43.098183 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-76631129-2fac-4167-84a0-f247ad03ecfb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:43.242211 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-76631129-2fac-4167-84a0-f247ad03ecfb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:43.250997 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-76631129-2fac-4167-84a0-f247ad03ecfb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.171496 May 17 12:07:43.251630 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 120/216] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:43 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:44.271011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0821b4eb-30dd-4682-9ccf-fd4a9364aad3 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:44.272140 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0821b4eb-30dd-4682-9ccf-fd4a9364aad3 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:44.279212 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0821b4eb-30dd-4682-9ccf-fd4a9364aad3 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:44.279696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0821b4eb-30dd-4682-9ccf-fd4a9364aad3 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:44.280506 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0821b4eb-30dd-4682-9ccf-fd4a9364aad3 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:44.280996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0821b4eb-30dd-4682-9ccf-fd4a9364aad3 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:44.425065 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0821b4eb-30dd-4682-9ccf-fd4a9364aad3 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:44.433514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0821b4eb-30dd-4682-9ccf-fd4a9364aad3 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.166318 May 17 12:07:44.434153 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 97/217] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:44 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:45.450543 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-08f86512-e283-4b8a-8909-ec1cf09f4a18 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:45.451145 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-08f86512-e283-4b8a-8909-ec1cf09f4a18 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:45.457043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-08f86512-e283-4b8a-8909-ec1cf09f4a18 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:45.457490 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-08f86512-e283-4b8a-8909-ec1cf09f4a18 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:45.458245 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-08f86512-e283-4b8a-8909-ec1cf09f4a18 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:45.458673 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-08f86512-e283-4b8a-8909-ec1cf09f4a18 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:45.589899 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-08f86512-e283-4b8a-8909-ec1cf09f4a18 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:45.597183 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-08f86512-e283-4b8a-8909-ec1cf09f4a18 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.150370 May 17 12:07:45.597746 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 121/218] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:45 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:46.614365 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8bf56742-1ea2-40c3-8ff7-153ee87b1c8d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:46.614912 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8bf56742-1ea2-40c3-8ff7-153ee87b1c8d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:46.621302 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bf56742-1ea2-40c3-8ff7-153ee87b1c8d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:46.621755 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bf56742-1ea2-40c3-8ff7-153ee87b1c8d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:46.622521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bf56742-1ea2-40c3-8ff7-153ee87b1c8d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:46.622963 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bf56742-1ea2-40c3-8ff7-153ee87b1c8d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:46.753766 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8bf56742-1ea2-40c3-8ff7-153ee87b1c8d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:46.762215 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8bf56742-1ea2-40c3-8ff7-153ee87b1c8d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.151586 May 17 12:07:46.762898 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 98/219] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:46 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:47.779808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-35e861d0-7db7-485b-b8e4-b98d34d05d91 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:47.780390 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-35e861d0-7db7-485b-b8e4-b98d34d05d91 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:47.786905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-35e861d0-7db7-485b-b8e4-b98d34d05d91 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:47.787549 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-35e861d0-7db7-485b-b8e4-b98d34d05d91 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:47.788523 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-35e861d0-7db7-485b-b8e4-b98d34d05d91 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:47.788959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-35e861d0-7db7-485b-b8e4-b98d34d05d91 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:47.920472 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-35e861d0-7db7-485b-b8e4-b98d34d05d91 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:47.927764 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-35e861d0-7db7-485b-b8e4-b98d34d05d91 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.152062 May 17 12:07:47.928347 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 122/220] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:47 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:48.944972 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b83b5397-375f-4deb-bd5f-d7b0defc4087 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:48.946282 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b83b5397-375f-4deb-bd5f-d7b0defc4087 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:48.953540 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b83b5397-375f-4deb-bd5f-d7b0defc4087 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:48.954197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b83b5397-375f-4deb-bd5f-d7b0defc4087 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:48.955185 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b83b5397-375f-4deb-bd5f-d7b0defc4087 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:48.955803 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b83b5397-375f-4deb-bd5f-d7b0defc4087 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:49.097432 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b83b5397-375f-4deb-bd5f-d7b0defc4087 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:49.105767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b83b5397-375f-4deb-bd5f-d7b0defc4087 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.164841 May 17 12:07:49.107022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 99/221] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:48 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:50.123589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-31dae2a4-6a3a-4cc9-9385-b56a359b5981 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:50.124226 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-31dae2a4-6a3a-4cc9-9385-b56a359b5981 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:50.130058 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-31dae2a4-6a3a-4cc9-9385-b56a359b5981 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:50.130457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-31dae2a4-6a3a-4cc9-9385-b56a359b5981 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:50.131227 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-31dae2a4-6a3a-4cc9-9385-b56a359b5981 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:50.131668 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-31dae2a4-6a3a-4cc9-9385-b56a359b5981 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:50.263409 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-31dae2a4-6a3a-4cc9-9385-b56a359b5981 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:50.270555 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-31dae2a4-6a3a-4cc9-9385-b56a359b5981 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.150803 May 17 12:07:50.271118 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 123/222] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:50 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:51.287659 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5a6acc11-a31d-4377-b82f-a558327ac0d1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:51.288311 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5a6acc11-a31d-4377-b82f-a558327ac0d1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:51.295763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a6acc11-a31d-4377-b82f-a558327ac0d1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:51.296252 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a6acc11-a31d-4377-b82f-a558327ac0d1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:51.297034 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a6acc11-a31d-4377-b82f-a558327ac0d1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:51.297481 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a6acc11-a31d-4377-b82f-a558327ac0d1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:51.435442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5a6acc11-a31d-4377-b82f-a558327ac0d1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:51.442786 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5a6acc11-a31d-4377-b82f-a558327ac0d1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.158946 May 17 12:07:51.443360 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 100/223] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:51 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:52.462122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-476454b4-bbd1-4cf9-add7-51086e2e74b0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:52.462737 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-476454b4-bbd1-4cf9-add7-51086e2e74b0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:52.468708 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-476454b4-bbd1-4cf9-add7-51086e2e74b0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:52.469151 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-476454b4-bbd1-4cf9-add7-51086e2e74b0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:52.470103 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-476454b4-bbd1-4cf9-add7-51086e2e74b0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:52.470538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-476454b4-bbd1-4cf9-add7-51086e2e74b0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:52.635654 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-476454b4-bbd1-4cf9-add7-51086e2e74b0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:52.642933 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-476454b4-bbd1-4cf9-add7-51086e2e74b0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.186337 May 17 12:07:52.643673 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 124/224] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:52 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:53.661075 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0016446c-19d7-497d-b671-0f49dd9637fc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:53.661689 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0016446c-19d7-497d-b671-0f49dd9637fc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:53.670429 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0016446c-19d7-497d-b671-0f49dd9637fc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:53.671497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0016446c-19d7-497d-b671-0f49dd9637fc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:53.672034 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0016446c-19d7-497d-b671-0f49dd9637fc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:53.672578 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0016446c-19d7-497d-b671-0f49dd9637fc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:53.823213 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0016446c-19d7-497d-b671-0f49dd9637fc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:53.832000 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0016446c-19d7-497d-b671-0f49dd9637fc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.174575 May 17 12:07:53.833222 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 101/225] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:53 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:54.850888 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d138e50f-832b-4d82-b48d-41b5faed14cd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:54.851495 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d138e50f-832b-4d82-b48d-41b5faed14cd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:54.857908 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d138e50f-832b-4d82-b48d-41b5faed14cd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:54.858358 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d138e50f-832b-4d82-b48d-41b5faed14cd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:54.859117 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d138e50f-832b-4d82-b48d-41b5faed14cd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:54.859556 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d138e50f-832b-4d82-b48d-41b5faed14cd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:54.984091 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d138e50f-832b-4d82-b48d-41b5faed14cd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:54.991302 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d138e50f-832b-4d82-b48d-41b5faed14cd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.144241 May 17 12:07:54.991868 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 125/226] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:54 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:07:56.007904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c9a1b710-a245-4b75-8705-1d8e0409177d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:56.009364 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c9a1b710-a245-4b75-8705-1d8e0409177d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:56.015497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c9a1b710-a245-4b75-8705-1d8e0409177d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:56.015946 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c9a1b710-a245-4b75-8705-1d8e0409177d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:56.016747 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c9a1b710-a245-4b75-8705-1d8e0409177d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:56.017185 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c9a1b710-a245-4b75-8705-1d8e0409177d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:56.140944 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c9a1b710-a245-4b75-8705-1d8e0409177d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:56.148185 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c9a1b710-a245-4b75-8705-1d8e0409177d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.144042 May 17 12:07:56.148756 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 102/227] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:56 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:57.164883 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5a286e42-49ed-4154-a066-0e09102a0628 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:57.165488 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5a286e42-49ed-4154-a066-0e09102a0628 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:57.171353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5a286e42-49ed-4154-a066-0e09102a0628 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:57.171800 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5a286e42-49ed-4154-a066-0e09102a0628 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:57.172585 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5a286e42-49ed-4154-a066-0e09102a0628 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:57.173022 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5a286e42-49ed-4154-a066-0e09102a0628 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:57.295777 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5a286e42-49ed-4154-a066-0e09102a0628 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:57.302954 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5a286e42-49ed-4154-a066-0e09102a0628 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.142001 May 17 12:07:57.303511 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 126/228] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:57 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:58.318742 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b4186569-9a58-4a40-ab23-c4630a40282a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:58.319357 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b4186569-9a58-4a40-ab23-c4630a40282a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:58.326610 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b4186569-9a58-4a40-ab23-c4630a40282a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:58.327059 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b4186569-9a58-4a40-ab23-c4630a40282a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:58.327843 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b4186569-9a58-4a40-ab23-c4630a40282a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:58.328335 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b4186569-9a58-4a40-ab23-c4630a40282a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:58.458084 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b4186569-9a58-4a40-ab23-c4630a40282a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:58.466304 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b4186569-9a58-4a40-ab23-c4630a40282a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.151420 May 17 12:07:58.466874 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 103/229] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:58 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:07:59.482954 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a517fcc5-bcca-4b88-8de4-db85d8fe631f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:07:59.483624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a517fcc5-bcca-4b88-8de4-db85d8fe631f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:07:59.490278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a517fcc5-bcca-4b88-8de4-db85d8fe631f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:59.490841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a517fcc5-bcca-4b88-8de4-db85d8fe631f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:59.491616 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a517fcc5-bcca-4b88-8de4-db85d8fe631f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:07:59.492046 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a517fcc5-bcca-4b88-8de4-db85d8fe631f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:07:59.646696 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a517fcc5-bcca-4b88-8de4-db85d8fe631f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:07:59.655810 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a517fcc5-bcca-4b88-8de4-db85d8fe631f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.176621 May 17 12:07:59.656650 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 127/230] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:07:59 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:00.673629 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-bb1c1c25-5a13-40e9-acb7-4cb065aa8770 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:00.674243 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-bb1c1c25-5a13-40e9-acb7-4cb065aa8770 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:00.680712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bb1c1c25-5a13-40e9-acb7-4cb065aa8770 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:00.681176 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bb1c1c25-5a13-40e9-acb7-4cb065aa8770 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:00.681941 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bb1c1c25-5a13-40e9-acb7-4cb065aa8770 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:00.682383 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bb1c1c25-5a13-40e9-acb7-4cb065aa8770 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:00.829659 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-bb1c1c25-5a13-40e9-acb7-4cb065aa8770 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:00.839255 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-bb1c1c25-5a13-40e9-acb7-4cb065aa8770 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.169414 May 17 12:08:00.839955 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 104/231] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:00 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:01.858195 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6b682d05-da6f-4bdf-9e37-b54d876802a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:01.858803 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6b682d05-da6f-4bdf-9e37-b54d876802a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:01.865356 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b682d05-da6f-4bdf-9e37-b54d876802a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:01.866096 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b682d05-da6f-4bdf-9e37-b54d876802a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:01.866782 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b682d05-da6f-4bdf-9e37-b54d876802a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:01.867306 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b682d05-da6f-4bdf-9e37-b54d876802a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:02.025939 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6b682d05-da6f-4bdf-9e37-b54d876802a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:02.033551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6b682d05-da6f-4bdf-9e37-b54d876802a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.179345 May 17 12:08:02.034329 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 128/232] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:01 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:03.053374 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e46636f8-5784-4c86-85a7-529cda6bf959 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:03.053981 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e46636f8-5784-4c86-85a7-529cda6bf959 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:03.061579 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e46636f8-5784-4c86-85a7-529cda6bf959 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:03.062266 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e46636f8-5784-4c86-85a7-529cda6bf959 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:03.063091 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e46636f8-5784-4c86-85a7-529cda6bf959 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:03.063534 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e46636f8-5784-4c86-85a7-529cda6bf959 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:03.211454 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e46636f8-5784-4c86-85a7-529cda6bf959 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:03.219547 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e46636f8-5784-4c86-85a7-529cda6bf959 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.169955 May 17 12:08:03.220403 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 105/233] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:03 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:04.237971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ad94912d-4299-42b4-b5f2-77378c853447 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:04.238775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ad94912d-4299-42b4-b5f2-77378c853447 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:04.244782 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad94912d-4299-42b4-b5f2-77378c853447 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:04.245234 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad94912d-4299-42b4-b5f2-77378c853447 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:04.246021 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad94912d-4299-42b4-b5f2-77378c853447 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:04.246457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad94912d-4299-42b4-b5f2-77378c853447 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:04.469916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ad94912d-4299-42b4-b5f2-77378c853447 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:04.482771 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ad94912d-4299-42b4-b5f2-77378c853447 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.249153 May 17 12:08:04.483361 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 129/234] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:04 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:05.499479 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d1d750ef-2abe-4cfd-8c8e-dd241869484d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:05.500228 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d1d750ef-2abe-4cfd-8c8e-dd241869484d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:05.506449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1d750ef-2abe-4cfd-8c8e-dd241869484d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:05.506911 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1d750ef-2abe-4cfd-8c8e-dd241869484d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:05.507718 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1d750ef-2abe-4cfd-8c8e-dd241869484d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:05.508165 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1d750ef-2abe-4cfd-8c8e-dd241869484d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:05.711893 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d1d750ef-2abe-4cfd-8c8e-dd241869484d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:05.719704 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d1d750ef-2abe-4cfd-8c8e-dd241869484d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.224372 May 17 12:08:05.720522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 106/235] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:05 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:06.395613 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-703686915", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "networks": [{"uuid": "df2d2de6-ecb9-4187-b033-becb493fafc0"}]}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:06.469470 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.network.neutron [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] validate_networks() for [('df2d2de6-ecb9-4187-b033-becb493fafc0', None, None, None, None, None)] {{(pid=117114) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:08:06.738696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-bfd55e52-6aa8-404f-aefb-832736c637eb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:06.739305 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-bfd55e52-6aa8-404f-aefb-832736c637eb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:06.747818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bfd55e52-6aa8-404f-aefb-832736c637eb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:06.749213 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bfd55e52-6aa8-404f-aefb-832736c637eb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:06.750292 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bfd55e52-6aa8-404f-aefb-832736c637eb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:06.750948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bfd55e52-6aa8-404f-aefb-832736c637eb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:06.952231 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-bfd55e52-6aa8-404f-aefb-832736c637eb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:06.972668 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-bfd55e52-6aa8-404f-aefb-832736c637eb tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.239338 May 17 12:08:06.973535 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 107/236] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:06 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:08:06.986076 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Flavor limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:08:06.986637 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Image limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:08:06.987177 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Flavor pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:08:06.987642 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Image pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:08:06.988125 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:08:06.997612 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:06.998197 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:06.999008 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:06.999449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:07.029413 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Getting quotas for project a69c8441974b4749bd43a2ccf3629332. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:08:07.046902 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Getting quotas for user f45cfe92bd7641b6b78b99938767bc32 and project a69c8441974b4749bd43a2ccf3629332. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:08:07.068554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Going to run 1 instances... {{(pid=117114) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:08:07.074915 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:08:07.133008 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8ce62a19-0aaa-445b-bd1e-5e14e658c2b9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741507 May 17 12:08:07.134804 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 130/237] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:08:07.145299 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-061a563a-99cc-4cbd-a60d-6a0b0fee7b69 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:07.146189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-061a563a-99cc-4cbd-a60d-6a0b0fee7b69 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:07.217515 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-061a563a-99cc-4cbd-a60d-6a0b0fee7b69 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:07.224730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-061a563a-99cc-4cbd-a60d-6a0b0fee7b69 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1218 microversion: 2.1 time: 0.083020 May 17 12:08:07.225416 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 108/238] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:07 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:08.000620 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9d2b1dcd-a809-44fc-b647-e1d05875a885 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:08.001756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9d2b1dcd-a809-44fc-b647-e1d05875a885 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:08.008926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9d2b1dcd-a809-44fc-b647-e1d05875a885 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:08.009728 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9d2b1dcd-a809-44fc-b647-e1d05875a885 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:08.010550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9d2b1dcd-a809-44fc-b647-e1d05875a885 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:08.011459 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9d2b1dcd-a809-44fc-b647-e1d05875a885 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:08.244476 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c6de12fa-75a3-45b7-92c5-0029e7be0da7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:08.246012 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c6de12fa-75a3-45b7-92c5-0029e7be0da7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:08.254831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c6de12fa-75a3-45b7-92c5-0029e7be0da7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:08.256719 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c6de12fa-75a3-45b7-92c5-0029e7be0da7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:08.257745 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c6de12fa-75a3-45b7-92c5-0029e7be0da7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:08.258287 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c6de12fa-75a3-45b7-92c5-0029e7be0da7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:08.273023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9d2b1dcd-a809-44fc-b647-e1d05875a885 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:08.283137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9d2b1dcd-a809-44fc-b647-e1d05875a885 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.295123 May 17 12:08:08.293628 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 131/239] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:07 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:08.342723 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c6de12fa-75a3-45b7-92c5-0029e7be0da7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:08.351667 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c6de12fa-75a3-45b7-92c5-0029e7be0da7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1222 microversion: 2.1 time: 0.111558 May 17 12:08:08.352283 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 109/240] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:08 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:09.300644 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b1ab2ece-7bde-4e16-bf15-c1a1904d42a8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:09.301254 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b1ab2ece-7bde-4e16-bf15-c1a1904d42a8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:09.310353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1ab2ece-7bde-4e16-bf15-c1a1904d42a8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:09.311832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1ab2ece-7bde-4e16-bf15-c1a1904d42a8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:09.313224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1ab2ece-7bde-4e16-bf15-c1a1904d42a8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:09.313879 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1ab2ece-7bde-4e16-bf15-c1a1904d42a8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:09.375567 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-78239a9c-9bfc-45fa-aebb-99d374062f15 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:09.375567 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-78239a9c-9bfc-45fa-aebb-99d374062f15 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:09.378793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-78239a9c-9bfc-45fa-aebb-99d374062f15 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:09.379251 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-78239a9c-9bfc-45fa-aebb-99d374062f15 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:09.380043 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-78239a9c-9bfc-45fa-aebb-99d374062f15 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:09.380519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-78239a9c-9bfc-45fa-aebb-99d374062f15 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:09.462890 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-78239a9c-9bfc-45fa-aebb-99d374062f15 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:09.470793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-78239a9c-9bfc-45fa-aebb-99d374062f15 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1222 microversion: 2.1 time: 0.105109 May 17 12:08:09.471537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 110/241] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:09 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:09.578815 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b1ab2ece-7bde-4e16-bf15-c1a1904d42a8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:09.586458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b1ab2ece-7bde-4e16-bf15-c1a1904d42a8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.289520 May 17 12:08:09.587806 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 132/242] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:09 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:10.491002 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d3140859-a723-4e23-af6b-d779e7628dce tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:10.491832 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d3140859-a723-4e23-af6b-d779e7628dce tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:10.499855 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d3140859-a723-4e23-af6b-d779e7628dce tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:10.500647 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d3140859-a723-4e23-af6b-d779e7628dce tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:10.501432 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d3140859-a723-4e23-af6b-d779e7628dce tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:10.502072 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d3140859-a723-4e23-af6b-d779e7628dce tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:10.581903 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d3140859-a723-4e23-af6b-d779e7628dce tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:10.589881 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d3140859-a723-4e23-af6b-d779e7628dce tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1222 microversion: 2.1 time: 0.104291 May 17 12:08:10.590453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 111/243] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:10 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:10.605542 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8b701e6d-2103-4c9e-8f3d-f6b2bfb3a493 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:10.606166 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8b701e6d-2103-4c9e-8f3d-f6b2bfb3a493 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:10.612267 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8b701e6d-2103-4c9e-8f3d-f6b2bfb3a493 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:10.612681 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8b701e6d-2103-4c9e-8f3d-f6b2bfb3a493 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:10.613638 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8b701e6d-2103-4c9e-8f3d-f6b2bfb3a493 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:10.614079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8b701e6d-2103-4c9e-8f3d-f6b2bfb3a493 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:10.820041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8b701e6d-2103-4c9e-8f3d-f6b2bfb3a493 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:10.828653 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8b701e6d-2103-4c9e-8f3d-f6b2bfb3a493 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.227814 May 17 12:08:10.829234 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 133/244] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:10 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:11.607305 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2ed16571-ad10-4126-9726-929652e939d8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:11.607835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2ed16571-ad10-4126-9726-929652e939d8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:11.614308 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2ed16571-ad10-4126-9726-929652e939d8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:11.614738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2ed16571-ad10-4126-9726-929652e939d8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:11.615721 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2ed16571-ad10-4126-9726-929652e939d8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:11.616148 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2ed16571-ad10-4126-9726-929652e939d8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:11.687395 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2ed16571-ad10-4126-9726-929652e939d8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:11.695622 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2ed16571-ad10-4126-9726-929652e939d8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1222 microversion: 2.1 time: 0.093139 May 17 12:08:11.696606 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 112/245] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:11 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:11.846756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-776fc569-d07e-434e-a536-db5119c6802a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:11.847373 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-776fc569-d07e-434e-a536-db5119c6802a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:11.855260 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-776fc569-d07e-434e-a536-db5119c6802a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:11.855712 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-776fc569-d07e-434e-a536-db5119c6802a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:11.856538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-776fc569-d07e-434e-a536-db5119c6802a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:11.856976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-776fc569-d07e-434e-a536-db5119c6802a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:12.060931 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-776fc569-d07e-434e-a536-db5119c6802a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:12.070826 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-776fc569-d07e-434e-a536-db5119c6802a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.227959 May 17 12:08:12.081632 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 134/246] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:11 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:12.713004 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-00919215-024d-4538-9f5d-5655de565ccb tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:12.714397 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-00919215-024d-4538-9f5d-5655de565ccb tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:12.721303 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-00919215-024d-4538-9f5d-5655de565ccb tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:12.722080 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-00919215-024d-4538-9f5d-5655de565ccb tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:12.723306 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-00919215-024d-4538-9f5d-5655de565ccb tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:12.724284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-00919215-024d-4538-9f5d-5655de565ccb tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:12.806911 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-00919215-024d-4538-9f5d-5655de565ccb tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:12.815605 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-00919215-024d-4538-9f5d-5655de565ccb tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1222 microversion: 2.1 time: 0.106519 May 17 12:08:12.816936 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 113/247] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:12 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:13.092875 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a6dc3cf3-11d8-4d2c-9a1c-af6f51b43520 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:13.093556 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a6dc3cf3-11d8-4d2c-9a1c-af6f51b43520 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:13.101343 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a6dc3cf3-11d8-4d2c-9a1c-af6f51b43520 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:13.101794 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a6dc3cf3-11d8-4d2c-9a1c-af6f51b43520 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:13.103251 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a6dc3cf3-11d8-4d2c-9a1c-af6f51b43520 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:13.103540 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a6dc3cf3-11d8-4d2c-9a1c-af6f51b43520 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:13.484927 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a6dc3cf3-11d8-4d2c-9a1c-af6f51b43520 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:13.495583 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a6dc3cf3-11d8-4d2c-9a1c-af6f51b43520 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.410504 May 17 12:08:13.497272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 135/248] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:13 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:13.834986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a5828107-cfa9-492e-bbea-1d097e11338f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:13.835599 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a5828107-cfa9-492e-bbea-1d097e11338f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:13.846670 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a5828107-cfa9-492e-bbea-1d097e11338f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:13.848614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a5828107-cfa9-492e-bbea-1d097e11338f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:13.853552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a5828107-cfa9-492e-bbea-1d097e11338f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:13.854586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a5828107-cfa9-492e-bbea-1d097e11338f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:14.043937 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a5828107-cfa9-492e-bbea-1d097e11338f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:14.056706 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a5828107-cfa9-492e-bbea-1d097e11338f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1222 microversion: 2.1 time: 0.222399 May 17 12:08:14.058483 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 114/249] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:13 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:14.517321 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c109a2a4-2321-4dae-a18f-896340c0d9df tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:14.518530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c109a2a4-2321-4dae-a18f-896340c0d9df tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:14.544702 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c109a2a4-2321-4dae-a18f-896340c0d9df tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:14.545431 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c109a2a4-2321-4dae-a18f-896340c0d9df tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:14.546457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c109a2a4-2321-4dae-a18f-896340c0d9df tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:14.547032 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c109a2a4-2321-4dae-a18f-896340c0d9df tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:14.805417 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c109a2a4-2321-4dae-a18f-896340c0d9df tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:14.815019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c109a2a4-2321-4dae-a18f-896340c0d9df tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.306217 May 17 12:08:14.817986 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 136/250] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:14 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:15.079099 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-80b2ed58-4063-4144-a19d-4c4c5badbb23 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:15.079713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-80b2ed58-4063-4144-a19d-4c4c5badbb23 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:15.101883 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80b2ed58-4063-4144-a19d-4c4c5badbb23 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:15.102334 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80b2ed58-4063-4144-a19d-4c4c5badbb23 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:15.103665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80b2ed58-4063-4144-a19d-4c4c5badbb23 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:15.104166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80b2ed58-4063-4144-a19d-4c4c5badbb23 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:15.254653 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-80b2ed58-4063-4144-a19d-4c4c5badbb23 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:15.266043 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-80b2ed58-4063-4144-a19d-4c4c5badbb23 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1270 microversion: 2.1 time: 0.195264 May 17 12:08:15.266926 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 115/251] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:15 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:15.644887 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cae60b12-79e5-47c9-bd62-a42ccdcea5cd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Action: 'create', calling method: .version_select at 0x7f2db45d4670>, body: {"keypair": {"name": "tempest-TestShelveInstance-270066880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMlgD7xfYtIo8B6rvJOBw2OjSBGJOMQYZ/EuVU3LMJlYNfxXqYGuM8vhJ1JJ+Xcx37Z4iVQTutDS8vvcPqb/tQiSJwekhmESjnds/tb6yn1pgIj4E18zzDET8ns5SG4Zg=="}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:15.659120 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-cae60b12-79e5-47c9-bd62-a42ccdcea5cd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Getting quotas for project 76b64f5e92ae4a0a9f756026c2e398af. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:08:15.662905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-cae60b12-79e5-47c9-bd62-a42ccdcea5cd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Getting quotas for user 7330cf580a8644d28bfca1eb4cb75fb4 and project 76b64f5e92ae4a0a9f756026c2e398af. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:08:15.686328 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cae60b12-79e5-47c9-bd62-a42ccdcea5cd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.216489 May 17 12:08:15.686929 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 137/252] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 17 12:08:15 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:08:15.835425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5bdf4099-fe26-4a3d-b4f3-c0551ff2d897 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:15.836632 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5bdf4099-fe26-4a3d-b4f3-c0551ff2d897 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:15.856095 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5bdf4099-fe26-4a3d-b4f3-c0551ff2d897 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:15.856699 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5bdf4099-fe26-4a3d-b4f3-c0551ff2d897 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:15.857747 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5bdf4099-fe26-4a3d-b4f3-c0551ff2d897 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:15.858256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5bdf4099-fe26-4a3d-b4f3-c0551ff2d897 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:16.000432 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5bdf4099-fe26-4a3d-b4f3-c0551ff2d897 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:16.008120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5bdf4099-fe26-4a3d-b4f3-c0551ff2d897 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1523 microversion: 2.1 time: 0.176460 May 17 12:08:16.009517 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 116/253] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:15 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:16.284033 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-636b65f3-e8aa-49ae-bf7b-c6c37d8ea96d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:16.284636 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-636b65f3-e8aa-49ae-bf7b-c6c37d8ea96d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:16.291086 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-636b65f3-e8aa-49ae-bf7b-c6c37d8ea96d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:16.291545 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-636b65f3-e8aa-49ae-bf7b-c6c37d8ea96d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:16.292341 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-636b65f3-e8aa-49ae-bf7b-c6c37d8ea96d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:16.292781 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-636b65f3-e8aa-49ae-bf7b-c6c37d8ea96d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:16.362884 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-636b65f3-e8aa-49ae-bf7b-c6c37d8ea96d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:16.371654 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-636b65f3-e8aa-49ae-bf7b-c6c37d8ea96d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1270 microversion: 2.1 time: 0.091539 May 17 12:08:16.380635 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 138/254] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:16 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:17.026662 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6448ba90-a090-452c-a7ac-a8d0fe2396fa tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:17.027395 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6448ba90-a090-452c-a7ac-a8d0fe2396fa tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:17.034583 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6448ba90-a090-452c-a7ac-a8d0fe2396fa tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:17.035123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6448ba90-a090-452c-a7ac-a8d0fe2396fa tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:17.036302 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6448ba90-a090-452c-a7ac-a8d0fe2396fa tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:17.036482 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6448ba90-a090-452c-a7ac-a8d0fe2396fa tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:17.206034 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6448ba90-a090-452c-a7ac-a8d0fe2396fa tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:17.213746 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6448ba90-a090-452c-a7ac-a8d0fe2396fa tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1503 microversion: 2.1 time: 0.191044 May 17 12:08:17.214322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 117/255] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:17 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:17.229872 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ae5f514e-a00b-470b-a2e7-c863c33b7e7d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:17.230497 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ae5f514e-a00b-470b-a2e7-c863c33b7e7d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:17.236464 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ae5f514e-a00b-470b-a2e7-c863c33b7e7d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:17.236974 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ae5f514e-a00b-470b-a2e7-c863c33b7e7d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:17.237801 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ae5f514e-a00b-470b-a2e7-c863c33b7e7d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:17.238297 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ae5f514e-a00b-470b-a2e7-c863c33b7e7d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:17.371642 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ae5f514e-a00b-470b-a2e7-c863c33b7e7d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:17.379049 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ae5f514e-a00b-470b-a2e7-c863c33b7e7d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1516 microversion: 2.1 time: 0.153292 May 17 12:08:17.379619 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 139/256] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:17 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:17.396268 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0196116e-3018-4de7-8f84-9f9614bd41ef tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:17.396889 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0196116e-3018-4de7-8f84-9f9614bd41ef tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:17.403051 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0196116e-3018-4de7-8f84-9f9614bd41ef tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:17.403498 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0196116e-3018-4de7-8f84-9f9614bd41ef tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:17.404306 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0196116e-3018-4de7-8f84-9f9614bd41ef tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:17.404778 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0196116e-3018-4de7-8f84-9f9614bd41ef tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:17.484777 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0196116e-3018-4de7-8f84-9f9614bd41ef tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:17.492301 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0196116e-3018-4de7-8f84-9f9614bd41ef tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1270 microversion: 2.1 time: 0.099906 May 17 12:08:17.492862 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 118/257] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:17 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:08:18.510268 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5bd005cf-8705-491a-ad86-cc13b51bf906 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:18.510891 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5bd005cf-8705-491a-ad86-cc13b51bf906 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:18.527986 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5bd005cf-8705-491a-ad86-cc13b51bf906 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:18.528482 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5bd005cf-8705-491a-ad86-cc13b51bf906 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:18.529423 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5bd005cf-8705-491a-ad86-cc13b51bf906 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:18.529858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5bd005cf-8705-491a-ad86-cc13b51bf906 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:18.601538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5bd005cf-8705-491a-ad86-cc13b51bf906 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:18.610905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5bd005cf-8705-491a-ad86-cc13b51bf906 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1270 microversion: 2.1 time: 0.104572 May 17 12:08:18.611493 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 140/258] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:18 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:19.627075 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-80fdd9b9-5041-43c7-8037-102bfc855ee5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:19.627690 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-80fdd9b9-5041-43c7-8037-102bfc855ee5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:19.635428 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80fdd9b9-5041-43c7-8037-102bfc855ee5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:19.635874 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80fdd9b9-5041-43c7-8037-102bfc855ee5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:19.636680 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80fdd9b9-5041-43c7-8037-102bfc855ee5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:19.637110 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80fdd9b9-5041-43c7-8037-102bfc855ee5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:19.714093 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-80fdd9b9-5041-43c7-8037-102bfc855ee5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:19.721389 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-80fdd9b9-5041-43c7-8037-102bfc855ee5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1276 microversion: 2.1 time: 0.098246 May 17 12:08:19.721966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 119/259] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:19 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:20.738762 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2a3e64ab-81ef-45c5-b4af-5ccbf39910e2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:20.739384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2a3e64ab-81ef-45c5-b4af-5ccbf39910e2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:20.740541 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-5c2cead2-f9cf-4ec4-b5af-ddb02cd2da68 req-1d32b7fe-daf5-485c-853d-74b6da848c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b13499-6633-4afb-9e7d-535aa76a374d", "tag": "9f484cd3-9b81-441e-94e1-4b0c6fac9bf2"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:20.749474 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-5c2cead2-f9cf-4ec4-b5af-ddb02cd2da68 req-1d32b7fe-daf5-485c-853d-74b6da848c6d service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:20.751875 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-5c2cead2-f9cf-4ec4-b5af-ddb02cd2da68 req-1d32b7fe-daf5-485c-853d-74b6da848c6d service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:20.753023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a3e64ab-81ef-45c5-b4af-5ccbf39910e2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:20.753745 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a3e64ab-81ef-45c5-b4af-5ccbf39910e2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:20.754922 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a3e64ab-81ef-45c5-b4af-5ccbf39910e2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:20.755572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a3e64ab-81ef-45c5-b4af-5ccbf39910e2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:20.768757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-5c2cead2-f9cf-4ec4-b5af-ddb02cd2da68 req-1d32b7fe-daf5-485c-853d-74b6da848c6d service nova] Creating event network-changed:9f484cd3-9b81-441e-94e1-4b0c6fac9bf2 for instance 07b13499-6633-4afb-9e7d-535aa76a374d on hv-cinder-83769 May 17 12:08:20.776724 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-5c2cead2-f9cf-4ec4-b5af-ddb02cd2da68 req-1d32b7fe-daf5-485c-853d-74b6da848c6d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039304 May 17 12:08:20.777147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 120/260] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:08:20.862904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-cfe4cfd7-3f5e-4299-b1a7-235f5872574e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:20.863962 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-cfe4cfd7-3f5e-4299-b1a7-235f5872574e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:20.870295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cfe4cfd7-3f5e-4299-b1a7-235f5872574e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:20.870738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cfe4cfd7-3f5e-4299-b1a7-235f5872574e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:20.871722 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cfe4cfd7-3f5e-4299-b1a7-235f5872574e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:20.872387 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cfe4cfd7-3f5e-4299-b1a7-235f5872574e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:20.897637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-cfe4cfd7-3f5e-4299-b1a7-235f5872574e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lazy-loading 'flavor' on Instance uuid 883228f9-d4df-4582-b768-db398beae543 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:08:20.909401 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2a3e64ab-81ef-45c5-b4af-5ccbf39910e2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:20.917972 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2a3e64ab-81ef-45c5-b4af-5ccbf39910e2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.183021 May 17 12:08:20.918751 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 141/261] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:20 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:21.026213 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-cfe4cfd7-3f5e-4299-b1a7-235f5872574e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543/action" status: 200 len: 32 microversion: 2.1 time: 0.167149 May 17 12:08:21.026993 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 121/262] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:08:20 2022] POST /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 12:08:21.036257 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-55f629b6-6a7c-4427-a3a4-1b26554c3277 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:21.037147 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-55f629b6-6a7c-4427-a3a4-1b26554c3277 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:21.046454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-55f629b6-6a7c-4427-a3a4-1b26554c3277 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:21.047139 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-55f629b6-6a7c-4427-a3a4-1b26554c3277 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:21.048109 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-55f629b6-6a7c-4427-a3a4-1b26554c3277 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:21.048748 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-55f629b6-6a7c-4427-a3a4-1b26554c3277 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:21.191758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-55f629b6-6a7c-4427-a3a4-1b26554c3277 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:21.200045 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-55f629b6-6a7c-4427-a3a4-1b26554c3277 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.167840 May 17 12:08:21.200928 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 142/263] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:21 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:21.936409 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7557c00f-4a3d-4ee0-a2d8-8a93bf63244c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:21.937118 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7557c00f-4a3d-4ee0-a2d8-8a93bf63244c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:21.943435 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7557c00f-4a3d-4ee0-a2d8-8a93bf63244c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:21.943892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7557c00f-4a3d-4ee0-a2d8-8a93bf63244c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:21.944723 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7557c00f-4a3d-4ee0-a2d8-8a93bf63244c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:21.945413 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7557c00f-4a3d-4ee0-a2d8-8a93bf63244c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:22.090949 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7557c00f-4a3d-4ee0-a2d8-8a93bf63244c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:22.099029 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7557c00f-4a3d-4ee0-a2d8-8a93bf63244c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.167248 May 17 12:08:22.099614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 122/264] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:21 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:22.218410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-05a67376-3f76-4908-8bd8-3be49662bebc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:22.219020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-05a67376-3f76-4908-8bd8-3be49662bebc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:22.225029 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-05a67376-3f76-4908-8bd8-3be49662bebc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:22.225475 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-05a67376-3f76-4908-8bd8-3be49662bebc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:22.226241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-05a67376-3f76-4908-8bd8-3be49662bebc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:22.226674 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-05a67376-3f76-4908-8bd8-3be49662bebc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:22.360778 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-05a67376-3f76-4908-8bd8-3be49662bebc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:22.368104 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-05a67376-3f76-4908-8bd8-3be49662bebc tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.153527 May 17 12:08:22.368833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 143/265] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:22 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:23.122862 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4b9e5b6c-242c-4f37-8bd5-7e510ea635b3 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:23.123395 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4b9e5b6c-242c-4f37-8bd5-7e510ea635b3 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:23.129779 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b9e5b6c-242c-4f37-8bd5-7e510ea635b3 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:23.130225 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b9e5b6c-242c-4f37-8bd5-7e510ea635b3 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:23.130981 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b9e5b6c-242c-4f37-8bd5-7e510ea635b3 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:23.131415 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b9e5b6c-242c-4f37-8bd5-7e510ea635b3 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:23.261464 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4b9e5b6c-242c-4f37-8bd5-7e510ea635b3 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:23.268663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4b9e5b6c-242c-4f37-8bd5-7e510ea635b3 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.150385 May 17 12:08:23.269231 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 123/266] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:23 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:23.388049 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ec8a6536-26e3-47a5-8dc1-622b2d591063 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:23.388888 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ec8a6536-26e3-47a5-8dc1-622b2d591063 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:23.394763 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ec8a6536-26e3-47a5-8dc1-622b2d591063 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:23.395219 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ec8a6536-26e3-47a5-8dc1-622b2d591063 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:23.395998 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ec8a6536-26e3-47a5-8dc1-622b2d591063 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:23.396460 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ec8a6536-26e3-47a5-8dc1-622b2d591063 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:23.523833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ec8a6536-26e3-47a5-8dc1-622b2d591063 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:23.531962 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ec8a6536-26e3-47a5-8dc1-622b2d591063 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.147740 May 17 12:08:23.532909 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 144/267] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:23 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:24.285605 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d53665aa-65bd-4316-91cf-b2fd04b9935a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:24.286242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d53665aa-65bd-4316-91cf-b2fd04b9935a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:24.293444 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d53665aa-65bd-4316-91cf-b2fd04b9935a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:24.293896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d53665aa-65bd-4316-91cf-b2fd04b9935a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:24.294674 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d53665aa-65bd-4316-91cf-b2fd04b9935a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:24.295103 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d53665aa-65bd-4316-91cf-b2fd04b9935a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:24.425404 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d53665aa-65bd-4316-91cf-b2fd04b9935a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:24.433469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d53665aa-65bd-4316-91cf-b2fd04b9935a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.151725 May 17 12:08:24.434244 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 124/268] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:24 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:24.550583 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-50b6d886-2f88-449e-9d04-6e93d9334868 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:24.551370 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-50b6d886-2f88-449e-9d04-6e93d9334868 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:24.557652 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-50b6d886-2f88-449e-9d04-6e93d9334868 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:24.558094 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-50b6d886-2f88-449e-9d04-6e93d9334868 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:24.558852 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-50b6d886-2f88-449e-9d04-6e93d9334868 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:24.559283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-50b6d886-2f88-449e-9d04-6e93d9334868 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:24.892111 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-50b6d886-2f88-449e-9d04-6e93d9334868 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:24.900246 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-50b6d886-2f88-449e-9d04-6e93d9334868 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.354126 May 17 12:08:24.901024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 145/269] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:24 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:25.452291 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6818575c-8012-4ec6-aba2-6cece6f8c679 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:25.452918 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6818575c-8012-4ec6-aba2-6cece6f8c679 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:25.459334 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6818575c-8012-4ec6-aba2-6cece6f8c679 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:25.459787 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6818575c-8012-4ec6-aba2-6cece6f8c679 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:25.460587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6818575c-8012-4ec6-aba2-6cece6f8c679 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:25.461031 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6818575c-8012-4ec6-aba2-6cece6f8c679 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:25.627221 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6818575c-8012-4ec6-aba2-6cece6f8c679 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:25.635511 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6818575c-8012-4ec6-aba2-6cece6f8c679 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.188542 May 17 12:08:25.636103 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 125/270] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:25 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:25.917576 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-856813d4-62a7-494a-8c9c-5c72a242599f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:25.918185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-856813d4-62a7-494a-8c9c-5c72a242599f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:25.924055 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-856813d4-62a7-494a-8c9c-5c72a242599f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:25.924613 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-856813d4-62a7-494a-8c9c-5c72a242599f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:25.925357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-856813d4-62a7-494a-8c9c-5c72a242599f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:25.925802 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-856813d4-62a7-494a-8c9c-5c72a242599f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:26.066526 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-856813d4-62a7-494a-8c9c-5c72a242599f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:26.074911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-856813d4-62a7-494a-8c9c-5c72a242599f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.161253 May 17 12:08:26.075482 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 146/271] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:25 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:26.652825 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0b8ae9c3-35c8-4313-9f0c-2893975a828a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:26.653530 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0b8ae9c3-35c8-4313-9f0c-2893975a828a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:26.660088 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0b8ae9c3-35c8-4313-9f0c-2893975a828a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:26.660565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0b8ae9c3-35c8-4313-9f0c-2893975a828a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:26.661335 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0b8ae9c3-35c8-4313-9f0c-2893975a828a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:26.661799 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0b8ae9c3-35c8-4313-9f0c-2893975a828a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:26.943627 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0b8ae9c3-35c8-4313-9f0c-2893975a828a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:26.951565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0b8ae9c3-35c8-4313-9f0c-2893975a828a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.303135 May 17 12:08:26.952142 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 126/272] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:26 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:08:27.092115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7bb900c2-9869-49fd-9c43-e61f39ca7391 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:27.092756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7bb900c2-9869-49fd-9c43-e61f39ca7391 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:27.100024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7bb900c2-9869-49fd-9c43-e61f39ca7391 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:27.100756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7bb900c2-9869-49fd-9c43-e61f39ca7391 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:27.101646 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7bb900c2-9869-49fd-9c43-e61f39ca7391 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:27.104253 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7bb900c2-9869-49fd-9c43-e61f39ca7391 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:27.239766 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7bb900c2-9869-49fd-9c43-e61f39ca7391 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:27.247698 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7bb900c2-9869-49fd-9c43-e61f39ca7391 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.159457 May 17 12:08:27.248289 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 147/273] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:27 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:27.437508 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-9e0716c4-811a-4e68-baeb-0044571a34f0 req-c63f7ccc-cc25-4ec0-8455-f49e8a456791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b13499-6633-4afb-9e7d-535aa76a374d", "name": "network-vif-plugged", "status": "completed", "tag": "9f484cd3-9b81-441e-94e1-4b0c6fac9bf2"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:27.446217 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-9e0716c4-811a-4e68-baeb-0044571a34f0 req-c63f7ccc-cc25-4ec0-8455-f49e8a456791 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:27.446818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-9e0716c4-811a-4e68-baeb-0044571a34f0 req-c63f7ccc-cc25-4ec0-8455-f49e8a456791 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:27.460355 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-9e0716c4-811a-4e68-baeb-0044571a34f0 req-c63f7ccc-cc25-4ec0-8455-f49e8a456791 service nova] Creating event network-vif-plugged:9f484cd3-9b81-441e-94e1-4b0c6fac9bf2 for instance 07b13499-6633-4afb-9e7d-535aa76a374d on hv-cinder-83769 May 17 12:08:27.466030 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-9e0716c4-811a-4e68-baeb-0044571a34f0 req-c63f7ccc-cc25-4ec0-8455-f49e8a456791 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032059 May 17 12:08:27.466641 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 127/274] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:08:27.968990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ad40193c-c11a-4e37-b45f-f63a22f8b131 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:27.969530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ad40193c-c11a-4e37-b45f-f63a22f8b131 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:27.975310 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad40193c-c11a-4e37-b45f-f63a22f8b131 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:27.975760 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad40193c-c11a-4e37-b45f-f63a22f8b131 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:27.976563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad40193c-c11a-4e37-b45f-f63a22f8b131 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:27.977001 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad40193c-c11a-4e37-b45f-f63a22f8b131 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:28.105291 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ad40193c-c11a-4e37-b45f-f63a22f8b131 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:28.112576 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ad40193c-c11a-4e37-b45f-f63a22f8b131 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.147436 May 17 12:08:28.113133 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 148/275] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:27 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:28.265868 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c333125a-5234-4847-bf5a-644028c8e08f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:28.266709 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c333125a-5234-4847-bf5a-644028c8e08f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:28.273150 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c333125a-5234-4847-bf5a-644028c8e08f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:28.273606 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c333125a-5234-4847-bf5a-644028c8e08f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:28.274580 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c333125a-5234-4847-bf5a-644028c8e08f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:28.275138 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c333125a-5234-4847-bf5a-644028c8e08f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:28.408701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c333125a-5234-4847-bf5a-644028c8e08f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:28.415941 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c333125a-5234-4847-bf5a-644028c8e08f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.154285 May 17 12:08:28.416532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 128/276] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:28 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:29.129446 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1214112f-3d7c-45b0-bfbd-8a2c9ea8a49d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:29.130057 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1214112f-3d7c-45b0-bfbd-8a2c9ea8a49d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:29.136219 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1214112f-3d7c-45b0-bfbd-8a2c9ea8a49d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:29.136671 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1214112f-3d7c-45b0-bfbd-8a2c9ea8a49d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:29.137436 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1214112f-3d7c-45b0-bfbd-8a2c9ea8a49d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:29.137870 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1214112f-3d7c-45b0-bfbd-8a2c9ea8a49d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:29.270630 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1214112f-3d7c-45b0-bfbd-8a2c9ea8a49d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:29.278660 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1214112f-3d7c-45b0-bfbd-8a2c9ea8a49d tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.152988 May 17 12:08:29.279421 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 149/277] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:29 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:29.433048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e22bca5c-657e-482c-a554-7a0bf316c834 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:29.434286 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e22bca5c-657e-482c-a554-7a0bf316c834 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:29.441605 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e22bca5c-657e-482c-a554-7a0bf316c834 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:29.442204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e22bca5c-657e-482c-a554-7a0bf316c834 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:29.443074 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e22bca5c-657e-482c-a554-7a0bf316c834 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:29.443578 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e22bca5c-657e-482c-a554-7a0bf316c834 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:29.575687 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e22bca5c-657e-482c-a554-7a0bf316c834 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:29.582980 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e22bca5c-657e-482c-a554-7a0bf316c834 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.153888 May 17 12:08:29.583542 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 129/278] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:29 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:30.296031 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0d8d78ab-df48-4651-b340-913c78cd0f16 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:30.296605 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0d8d78ab-df48-4651-b340-913c78cd0f16 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:30.302509 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d8d78ab-df48-4651-b340-913c78cd0f16 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:30.302952 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d8d78ab-df48-4651-b340-913c78cd0f16 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:30.303788 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d8d78ab-df48-4651-b340-913c78cd0f16 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:30.304121 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d8d78ab-df48-4651-b340-913c78cd0f16 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:30.428441 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0d8d78ab-df48-4651-b340-913c78cd0f16 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:30.436496 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0d8d78ab-df48-4651-b340-913c78cd0f16 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.144424 May 17 12:08:30.437071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 150/279] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:30 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:30.599763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-96be1dc4-3606-47cd-b023-db1e3a6aae5d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:30.600503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-96be1dc4-3606-47cd-b023-db1e3a6aae5d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:30.607444 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-96be1dc4-3606-47cd-b023-db1e3a6aae5d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:30.607898 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-96be1dc4-3606-47cd-b023-db1e3a6aae5d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:30.608697 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-96be1dc4-3606-47cd-b023-db1e3a6aae5d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:30.609137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-96be1dc4-3606-47cd-b023-db1e3a6aae5d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:30.731962 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-96be1dc4-3606-47cd-b023-db1e3a6aae5d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:30.740547 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-96be1dc4-3606-47cd-b023-db1e3a6aae5d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.144568 May 17 12:08:30.741245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 130/280] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:30 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:31.453792 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bac445f9-e1d2-4082-b361-ffc151923d49 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:31.454399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bac445f9-e1d2-4082-b361-ffc151923d49 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:31.460208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bac445f9-e1d2-4082-b361-ffc151923d49 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:31.460658 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bac445f9-e1d2-4082-b361-ffc151923d49 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:31.461412 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bac445f9-e1d2-4082-b361-ffc151923d49 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:31.461841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bac445f9-e1d2-4082-b361-ffc151923d49 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:31.591065 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bac445f9-e1d2-4082-b361-ffc151923d49 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:31.598621 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bac445f9-e1d2-4082-b361-ffc151923d49 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.148559 May 17 12:08:31.599172 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 151/281] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:31 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:31.758480 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-38620b94-7e33-463b-9044-38027fb49736 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:31.759188 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-38620b94-7e33-463b-9044-38027fb49736 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:31.767057 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-38620b94-7e33-463b-9044-38027fb49736 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:31.767497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-38620b94-7e33-463b-9044-38027fb49736 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:31.768292 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-38620b94-7e33-463b-9044-38027fb49736 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:31.768724 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-38620b94-7e33-463b-9044-38027fb49736 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:31.901246 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-38620b94-7e33-463b-9044-38027fb49736 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:31.909257 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-38620b94-7e33-463b-9044-38027fb49736 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.155265 May 17 12:08:31.910132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 131/282] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:31 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:32.615911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4d5c5fec-4eaa-4ba6-b229-0221a85359ff tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:32.616569 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4d5c5fec-4eaa-4ba6-b229-0221a85359ff tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:32.623221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4d5c5fec-4eaa-4ba6-b229-0221a85359ff tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:32.623669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4d5c5fec-4eaa-4ba6-b229-0221a85359ff tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:32.624473 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4d5c5fec-4eaa-4ba6-b229-0221a85359ff tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:32.624916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4d5c5fec-4eaa-4ba6-b229-0221a85359ff tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:32.755914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4d5c5fec-4eaa-4ba6-b229-0221a85359ff tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:32.763647 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4d5c5fec-4eaa-4ba6-b229-0221a85359ff tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.151548 May 17 12:08:32.764272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 152/283] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:32 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:32.926517 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a08281e7-b37e-49d0-bfb4-4e16ea05268d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:32.927222 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a08281e7-b37e-49d0-bfb4-4e16ea05268d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:32.933783 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a08281e7-b37e-49d0-bfb4-4e16ea05268d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:32.934231 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a08281e7-b37e-49d0-bfb4-4e16ea05268d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:32.934998 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a08281e7-b37e-49d0-bfb4-4e16ea05268d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:32.935430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a08281e7-b37e-49d0-bfb4-4e16ea05268d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:33.062082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a08281e7-b37e-49d0-bfb4-4e16ea05268d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:33.070189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a08281e7-b37e-49d0-bfb4-4e16ea05268d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.147182 May 17 12:08:33.070798 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 132/284] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:32 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:33.783175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b2846ec3-6410-4201-a5ef-bae4d1f8444f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:33.783856 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b2846ec3-6410-4201-a5ef-bae4d1f8444f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:33.789964 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b2846ec3-6410-4201-a5ef-bae4d1f8444f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:33.790412 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b2846ec3-6410-4201-a5ef-bae4d1f8444f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:33.791717 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b2846ec3-6410-4201-a5ef-bae4d1f8444f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:33.792152 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b2846ec3-6410-4201-a5ef-bae4d1f8444f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:33.929954 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b2846ec3-6410-4201-a5ef-bae4d1f8444f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:33.938288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b2846ec3-6410-4201-a5ef-bae4d1f8444f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.160388 May 17 12:08:33.938865 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 153/285] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:33 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:34.088780 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-25f055b7-d108-406b-a389-d1f5a537492f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:34.089475 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-25f055b7-d108-406b-a389-d1f5a537492f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:34.096720 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-25f055b7-d108-406b-a389-d1f5a537492f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:34.097516 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-25f055b7-d108-406b-a389-d1f5a537492f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:34.098886 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-25f055b7-d108-406b-a389-d1f5a537492f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:34.099474 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-25f055b7-d108-406b-a389-d1f5a537492f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:34.241733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-25f055b7-d108-406b-a389-d1f5a537492f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:34.249808 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-25f055b7-d108-406b-a389-d1f5a537492f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.165667 May 17 12:08:34.250384 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 133/286] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:34 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:34.956868 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bf34c33c-0cc5-40e2-8428-5659d9e613c5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:34.957598 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bf34c33c-0cc5-40e2-8428-5659d9e613c5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:34.964102 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf34c33c-0cc5-40e2-8428-5659d9e613c5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:34.964561 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf34c33c-0cc5-40e2-8428-5659d9e613c5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:34.965317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf34c33c-0cc5-40e2-8428-5659d9e613c5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:34.965743 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf34c33c-0cc5-40e2-8428-5659d9e613c5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:35.100396 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bf34c33c-0cc5-40e2-8428-5659d9e613c5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:35.108709 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bf34c33c-0cc5-40e2-8428-5659d9e613c5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.155495 May 17 12:08:35.109290 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 154/287] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:34 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:35.270436 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d5f0bd00-448e-4bed-95d5-2537a78f6f81 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:35.270992 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d5f0bd00-448e-4bed-95d5-2537a78f6f81 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:35.277398 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d5f0bd00-448e-4bed-95d5-2537a78f6f81 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:35.277850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d5f0bd00-448e-4bed-95d5-2537a78f6f81 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:35.278620 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d5f0bd00-448e-4bed-95d5-2537a78f6f81 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:35.279057 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d5f0bd00-448e-4bed-95d5-2537a78f6f81 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:35.407799 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d5f0bd00-448e-4bed-95d5-2537a78f6f81 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:35.415110 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d5f0bd00-448e-4bed-95d5-2537a78f6f81 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.148906 May 17 12:08:35.415678 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 134/288] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:35 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:36.126547 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1cc2c471-855b-49e2-8acf-130f8ae11205 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:36.127647 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1cc2c471-855b-49e2-8acf-130f8ae11205 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:36.137442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1cc2c471-855b-49e2-8acf-130f8ae11205 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:36.137906 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1cc2c471-855b-49e2-8acf-130f8ae11205 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:36.138631 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1cc2c471-855b-49e2-8acf-130f8ae11205 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:36.139071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1cc2c471-855b-49e2-8acf-130f8ae11205 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:36.269284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1cc2c471-855b-49e2-8acf-130f8ae11205 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:36.276599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1cc2c471-855b-49e2-8acf-130f8ae11205 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.154535 May 17 12:08:36.277220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 155/289] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:36 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:36.433162 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4a3c2afe-5b1c-4aed-be40-1c0e887e0e41 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:36.433794 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4a3c2afe-5b1c-4aed-be40-1c0e887e0e41 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:36.440113 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4a3c2afe-5b1c-4aed-be40-1c0e887e0e41 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:36.440598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4a3c2afe-5b1c-4aed-be40-1c0e887e0e41 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:36.441371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4a3c2afe-5b1c-4aed-be40-1c0e887e0e41 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:36.441812 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4a3c2afe-5b1c-4aed-be40-1c0e887e0e41 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:36.568890 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4a3c2afe-5b1c-4aed-be40-1c0e887e0e41 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:36.576874 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4a3c2afe-5b1c-4aed-be40-1c0e887e0e41 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.148802 May 17 12:08:36.577459 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 135/290] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:36 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:37.293727 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-48dfdb47-a049-4a94-af73-9f55fdb050d7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:37.294249 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-48dfdb47-a049-4a94-af73-9f55fdb050d7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:37.300129 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-48dfdb47-a049-4a94-af73-9f55fdb050d7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:37.300609 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-48dfdb47-a049-4a94-af73-9f55fdb050d7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:37.301371 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-48dfdb47-a049-4a94-af73-9f55fdb050d7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:37.301805 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-48dfdb47-a049-4a94-af73-9f55fdb050d7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:37.434294 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-48dfdb47-a049-4a94-af73-9f55fdb050d7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:37.441620 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-48dfdb47-a049-4a94-af73-9f55fdb050d7 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1318 microversion: 2.1 time: 0.151839 May 17 12:08:37.442188 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 156/291] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:37 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:37.593915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e0e1ae9e-1ba1-4e56-9a7a-30e185224eba tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:37.594602 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e0e1ae9e-1ba1-4e56-9a7a-30e185224eba tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:37.600961 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0e1ae9e-1ba1-4e56-9a7a-30e185224eba tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:37.601412 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0e1ae9e-1ba1-4e56-9a7a-30e185224eba tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:37.602186 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0e1ae9e-1ba1-4e56-9a7a-30e185224eba tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:37.602623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0e1ae9e-1ba1-4e56-9a7a-30e185224eba tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:37.734655 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e0e1ae9e-1ba1-4e56-9a7a-30e185224eba tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:37.741901 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e0e1ae9e-1ba1-4e56-9a7a-30e185224eba tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.151918 May 17 12:08:37.742469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 136/292] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:37 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:38.458844 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cc152f5c-c035-4132-88ad-727f3981c5d6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:38.459457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cc152f5c-c035-4132-88ad-727f3981c5d6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:38.465476 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cc152f5c-c035-4132-88ad-727f3981c5d6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:38.466008 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cc152f5c-c035-4132-88ad-727f3981c5d6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:38.466676 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cc152f5c-c035-4132-88ad-727f3981c5d6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:38.467110 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cc152f5c-c035-4132-88ad-727f3981c5d6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:38.598657 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cc152f5c-c035-4132-88ad-727f3981c5d6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:38.606611 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cc152f5c-c035-4132-88ad-727f3981c5d6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1507 microversion: 2.1 time: 0.151541 May 17 12:08:38.607191 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 157/293] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:38 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:38.759116 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-986e53b8-6808-48af-a531-d6a55ad4a1c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:38.759807 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-986e53b8-6808-48af-a531-d6a55ad4a1c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:38.766779 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-986e53b8-6808-48af-a531-d6a55ad4a1c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:38.767115 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-986e53b8-6808-48af-a531-d6a55ad4a1c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:38.768208 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-986e53b8-6808-48af-a531-d6a55ad4a1c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:38.768715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-986e53b8-6808-48af-a531-d6a55ad4a1c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:38.919304 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-986e53b8-6808-48af-a531-d6a55ad4a1c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:38.928172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-986e53b8-6808-48af-a531-d6a55ad4a1c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.173400 May 17 12:08:38.928896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 137/294] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:38 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:39.948325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9309f988-f572-4796-a416-0554aa504f0d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:39.948961 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9309f988-f572-4796-a416-0554aa504f0d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:39.955078 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9309f988-f572-4796-a416-0554aa504f0d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:39.955682 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9309f988-f572-4796-a416-0554aa504f0d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:39.956504 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9309f988-f572-4796-a416-0554aa504f0d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:39.957118 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9309f988-f572-4796-a416-0554aa504f0d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:40.123523 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9309f988-f572-4796-a416-0554aa504f0d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:40.131437 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9309f988-f572-4796-a416-0554aa504f0d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.189530 May 17 12:08:40.132099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 158/295] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:39 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:41.148758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1477ad73-73e6-4085-ae15-040768059c37 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:41.149381 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1477ad73-73e6-4085-ae15-040768059c37 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:41.155867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1477ad73-73e6-4085-ae15-040768059c37 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:41.156346 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1477ad73-73e6-4085-ae15-040768059c37 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:41.157310 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1477ad73-73e6-4085-ae15-040768059c37 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:41.157761 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1477ad73-73e6-4085-ae15-040768059c37 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:41.313398 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1477ad73-73e6-4085-ae15-040768059c37 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:41.321383 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1477ad73-73e6-4085-ae15-040768059c37 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.176242 May 17 12:08:41.331372 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 138/296] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:41 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:42.340645 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5e2a5bc9-38ec-4724-b187-26e6a6b1a376 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:42.341605 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5e2a5bc9-38ec-4724-b187-26e6a6b1a376 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:42.357468 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5e2a5bc9-38ec-4724-b187-26e6a6b1a376 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:42.357925 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5e2a5bc9-38ec-4724-b187-26e6a6b1a376 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:42.358734 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5e2a5bc9-38ec-4724-b187-26e6a6b1a376 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:42.359300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5e2a5bc9-38ec-4724-b187-26e6a6b1a376 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:42.498551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5e2a5bc9-38ec-4724-b187-26e6a6b1a376 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:42.510734 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5e2a5bc9-38ec-4724-b187-26e6a6b1a376 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.175432 May 17 12:08:42.511314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 159/297] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:42 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:43.528538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-145168e5-b14f-4b6c-b358-07a33742314e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:43.529619 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-145168e5-b14f-4b6c-b358-07a33742314e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:43.535646 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-145168e5-b14f-4b6c-b358-07a33742314e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:43.536089 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-145168e5-b14f-4b6c-b358-07a33742314e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:43.536894 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-145168e5-b14f-4b6c-b358-07a33742314e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:43.537329 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-145168e5-b14f-4b6c-b358-07a33742314e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:43.674707 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-145168e5-b14f-4b6c-b358-07a33742314e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:43.681927 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-145168e5-b14f-4b6c-b358-07a33742314e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1502 microversion: 2.1 time: 0.158181 May 17 12:08:43.682494 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 139/298] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:43 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:43.699325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8f43e907-175a-456b-8d84-51b5e5836b93 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e48aa824-ad9e-4f8a-acb8-9edd6034c552"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:43.701189 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8f43e907-175a-456b-8d84-51b5e5836b93 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:43.707038 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8f43e907-175a-456b-8d84-51b5e5836b93 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:43.707483 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8f43e907-175a-456b-8d84-51b5e5836b93 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:43.708268 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8f43e907-175a-456b-8d84-51b5e5836b93 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:43.708702 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8f43e907-175a-456b-8d84-51b5e5836b93 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:43.733727 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-8f43e907-175a-456b-8d84-51b5e5836b93 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] HTTP exception thrown: Cannot 'attach_volume' instance 883228f9-d4df-4582-b768-db398beae543 while it is in vm_state rescued May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8f43e907-175a-456b-8d84-51b5e5836b93 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Request method failure captured: May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: POST /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543/os-volume_attachments HTTP/1.1 May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 74 May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_ROk_1fuk4cSz3epPRbBpZJb2CV0MrGgAAQniHK1q4v073xWwEWOCjjjbaAzyH7LF1w321FNwq0gXKnr2mWTL4XsT6HSoqme_-3QFRdTe7OIjs4JYtwiPMJL6MsQslc-YpYZVP_mTuVvFoGMYBqqzFJ4V0WOb3GzluE0C5CvbO6aA May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 748d013ae6664fc79a9ac23e58f642e5 May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:08:43.735462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/748d013ae6664fc79a9ac23e58f642e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_748d013ae6664fc79a9ac23e58f642e5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/748d013ae6664fc79a9ac23e58f642e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/748d013ae6664fc79a9ac23e58f642e5"}]}] May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 748d013ae6664fc79a9ac23e58f642e5 May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-ServerRescueNegativeTestJSON-320091299-project May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: bb9da9200f804a4a987f2cdb49f6801d May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-ServerRescueNegativeTestJSON-320091299-project May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {"volumeAttachment": {"volumeId": "e48aa824-ad9e-4f8a-acb8-9edd6034c552"}} May 17 12:08:43.736926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Cannot 'attach_volume' instance 883228f9-d4df-4582-b768-db398beae543 while it is in vm_state rescued May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'server_id': '883228f9-d4df-4582-b768-db398beae543', 'body': {'volumeAttachment': {'volumeId': 'e48aa824-ad9e-4f8a-acb8-9edd6034c552'}}} May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 883228f9-d4df-4582-b768-db398beae543 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:08:43.737693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 883228f9-d4df-4582-b768-db398beae543 while it is in vm_state rescued May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:08:43.739041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:08:43.740590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:08:43.740590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:08:43.740590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 883228f9-d4df-4582-b768-db398beae543 while it is in vm_state rescued May 17 12:08:43.740590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:08:43.740590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8f43e907-175a-456b-8d84-51b5e5836b93 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Returning 409 to user: Cannot 'attach_volume' instance 883228f9-d4df-4582-b768-db398beae543 while it is in vm_state rescued {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:08:43.740590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8f43e907-175a-456b-8d84-51b5e5836b93 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042444 May 17 12:08:43.740590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 160/299] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:08:43 2022] POST /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 17 12:08:43.746193 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c7e169e1-0548-4c73-8c68-e094573a8db9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:43.746730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c7e169e1-0548-4c73-8c68-e094573a8db9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:43.752437 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c7e169e1-0548-4c73-8c68-e094573a8db9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:43.752891 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c7e169e1-0548-4c73-8c68-e094573a8db9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:43.753666 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c7e169e1-0548-4c73-8c68-e094573a8db9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:43.754103 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c7e169e1-0548-4c73-8c68-e094573a8db9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:43.823016 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c7e169e1-0548-4c73-8c68-e094573a8db9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543/action" status: 202 len: 0 microversion: 2.1 time: 0.080310 May 17 12:08:43.824915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 140/300] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:08:43 2022] POST /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:08:43.834238 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-90e4304b-9ce0-4f4c-9f9b-e84c07e10689 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:43.835055 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-90e4304b-9ce0-4f4c-9f9b-e84c07e10689 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:43.842911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90e4304b-9ce0-4f4c-9f9b-e84c07e10689 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:43.843366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90e4304b-9ce0-4f4c-9f9b-e84c07e10689 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:43.844145 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90e4304b-9ce0-4f4c-9f9b-e84c07e10689 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:43.844681 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90e4304b-9ce0-4f4c-9f9b-e84c07e10689 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:43.975989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-90e4304b-9ce0-4f4c-9f9b-e84c07e10689 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:43.983515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-90e4304b-9ce0-4f4c-9f9b-e84c07e10689 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1510 microversion: 2.1 time: 0.154094 May 17 12:08:43.984099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 161/301] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:43 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:08:45.001828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-394a38bd-ca8c-4029-9e16-5951588cfba1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:45.002566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-394a38bd-ca8c-4029-9e16-5951588cfba1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:45.009174 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-394a38bd-ca8c-4029-9e16-5951588cfba1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:45.009629 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-394a38bd-ca8c-4029-9e16-5951588cfba1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:45.010392 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-394a38bd-ca8c-4029-9e16-5951588cfba1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:45.011319 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-394a38bd-ca8c-4029-9e16-5951588cfba1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:45.147723 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-394a38bd-ca8c-4029-9e16-5951588cfba1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:45.156349 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-394a38bd-ca8c-4029-9e16-5951588cfba1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1510 microversion: 2.1 time: 0.158920 May 17 12:08:45.156927 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 141/302] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:44 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:46.173436 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-63d5d66b-5299-4546-b23c-7076480cd45a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:46.174052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-63d5d66b-5299-4546-b23c-7076480cd45a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:46.180139 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63d5d66b-5299-4546-b23c-7076480cd45a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:46.180616 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63d5d66b-5299-4546-b23c-7076480cd45a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:46.181385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63d5d66b-5299-4546-b23c-7076480cd45a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:46.181824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63d5d66b-5299-4546-b23c-7076480cd45a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:46.313001 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-63d5d66b-5299-4546-b23c-7076480cd45a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:46.320536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-63d5d66b-5299-4546-b23c-7076480cd45a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1510 microversion: 2.1 time: 0.150678 May 17 12:08:46.321287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 162/303] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:46 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:47.337675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c75bdfd0-952d-4250-83df-f831af3aceb9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:47.338319 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c75bdfd0-952d-4250-83df-f831af3aceb9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:47.344644 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c75bdfd0-952d-4250-83df-f831af3aceb9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:47.345094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c75bdfd0-952d-4250-83df-f831af3aceb9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:47.345862 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c75bdfd0-952d-4250-83df-f831af3aceb9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:47.346299 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c75bdfd0-952d-4250-83df-f831af3aceb9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:47.477300 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c75bdfd0-952d-4250-83df-f831af3aceb9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:47.485522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c75bdfd0-952d-4250-83df-f831af3aceb9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1510 microversion: 2.1 time: 0.151653 May 17 12:08:47.486101 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 142/304] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:47 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:48.503434 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fd2866ee-48c5-4ce0-b06c-0d82b2a4ad60 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:48.504045 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fd2866ee-48c5-4ce0-b06c-0d82b2a4ad60 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:48.509795 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd2866ee-48c5-4ce0-b06c-0d82b2a4ad60 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:48.510252 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd2866ee-48c5-4ce0-b06c-0d82b2a4ad60 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:48.511013 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd2866ee-48c5-4ce0-b06c-0d82b2a4ad60 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:48.511451 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd2866ee-48c5-4ce0-b06c-0d82b2a4ad60 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:48.639995 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fd2866ee-48c5-4ce0-b06c-0d82b2a4ad60 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:48.647800 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fd2866ee-48c5-4ce0-b06c-0d82b2a4ad60 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1510 microversion: 2.1 time: 0.148197 May 17 12:08:48.648594 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 163/305] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:48 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:49.665494 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-416d6730-7216-474f-a07f-7a5f392b2837 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:49.666112 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-416d6730-7216-474f-a07f-7a5f392b2837 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:49.673636 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-416d6730-7216-474f-a07f-7a5f392b2837 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:49.674101 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-416d6730-7216-474f-a07f-7a5f392b2837 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:49.675080 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-416d6730-7216-474f-a07f-7a5f392b2837 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:49.675314 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-416d6730-7216-474f-a07f-7a5f392b2837 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:49.770770 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-648038449", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-270066880", "security_groups": [{"name": "tempest-secgroup-smoke-1828174796"}], "networks": [{"uuid": "d65a31a7-b8ed-4ea2-811e-5054319f9793"}], "block_device_mapping_v2": [{"uuid": "93790543-a089-4932-9d13-92f6372f8a0b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:49.805717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-416d6730-7216-474f-a07f-7a5f392b2837 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:49.813731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-416d6730-7216-474f-a07f-7a5f392b2837 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1516 microversion: 2.1 time: 0.152134 May 17 12:08:49.814315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 143/306] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:49 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:49.899400 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.network.neutron [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] validate_networks() for [('d65a31a7-b8ed-4ea2-811e-5054319f9793', None, None, None, None, None)] {{(pid=117114) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:08:50.288234 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Flavor limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:08:50.288658 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Image limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:08:50.289132 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Flavor pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:08:50.289537 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Image pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:08:50.289947 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:08:50.298381 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:50.298828 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:50.299631 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:50.300068 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:50.315956 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Getting quotas for project 76b64f5e92ae4a0a9f756026c2e398af. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:08:50.319615 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Getting quotas for user 7330cf580a8644d28bfca1eb4cb75fb4 and project 76b64f5e92ae4a0a9f756026c2e398af. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:08:50.376659 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Going to run 1 instances... {{(pid=117114) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:08:50.378660 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='93790543-a089-4932-9d13-92f6372f8a0b',volume_size=None,volume_type=None)] {{(pid=117114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:08:50.511461 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d4b3518a-00ec-4e9f-8e1b-3cc85615caa1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745194 May 17 12:08:50.518043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 164/307] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:08:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 12:08:50.529442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7f84d675-0cb8-46ba-8336-49f7f21dcd36 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:50.530074 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7f84d675-0cb8-46ba-8336-49f7f21dcd36 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:50.600854 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7f84d675-0cb8-46ba-8336-49f7f21dcd36 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:50.608496 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7f84d675-0cb8-46ba-8336-49f7f21dcd36 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1087 microversion: 2.1 time: 0.089498 May 17 12:08:50.609337 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 144/308] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:50 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1087 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:08:51.157652 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1cc7aaae-82e9-4a27-b81d-6fbf5e7284b6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'create', calling method: .version_select at 0x7f2db45d48b0>, body: {"keypair": {"name": "tempest-keypair-1164837593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZZVIJNMTv2DLAHXwVJMxRppVW+5aT+MJLuGoheTTH0JBjHbjyOpoPsLGOBNxph04p0UFqoDR/Sbvxu+VeBu4x4gaZQwcOTT3GzhsuR+KC8Edun20mstiu0k+c1mVgEZQ=="}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:51.171929 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-1cc7aaae-82e9-4a27-b81d-6fbf5e7284b6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Getting quotas for project 748d013ae6664fc79a9ac23e58f642e5. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:08:51.175560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-1cc7aaae-82e9-4a27-b81d-6fbf5e7284b6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Getting quotas for user bb9da9200f804a4a987f2cdb49f6801d and project 748d013ae6664fc79a9ac23e58f642e5. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:08:51.198496 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1cc7aaae-82e9-4a27-b81d-6fbf5e7284b6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044678 May 17 12:08:51.199096 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 165/309] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 17 12:08:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:08:51.627212 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-93422684-9b3a-41c6-b42d-45aad46e2d3d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:51.628556 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-93422684-9b3a-41c6-b42d-45aad46e2d3d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:51.635619 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93422684-9b3a-41c6-b42d-45aad46e2d3d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:51.636160 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93422684-9b3a-41c6-b42d-45aad46e2d3d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:51.637622 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93422684-9b3a-41c6-b42d-45aad46e2d3d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:51.638136 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93422684-9b3a-41c6-b42d-45aad46e2d3d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:51.739914 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-93422684-9b3a-41c6-b42d-45aad46e2d3d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:51.749571 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-93422684-9b3a-41c6-b42d-45aad46e2d3d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1193 microversion: 2.1 time: 0.127163 May 17 12:08:51.750312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 145/310] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:51 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1193 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:52.767340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b1ad2efd-c181-4d1b-9fc4-7fcd7abf9923 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:52.767959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b1ad2efd-c181-4d1b-9fc4-7fcd7abf9923 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:52.773748 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1ad2efd-c181-4d1b-9fc4-7fcd7abf9923 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:52.774197 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1ad2efd-c181-4d1b-9fc4-7fcd7abf9923 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:52.774963 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1ad2efd-c181-4d1b-9fc4-7fcd7abf9923 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:52.775401 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1ad2efd-c181-4d1b-9fc4-7fcd7abf9923 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:52.843795 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b1ad2efd-c181-4d1b-9fc4-7fcd7abf9923 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:52.851672 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b1ad2efd-c181-4d1b-9fc4-7fcd7abf9923 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1191 microversion: 2.1 time: 0.088177 May 17 12:08:52.852287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 166/311] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:52 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:53.379335 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1632704172", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d0c04f0-74ef-4155-bac9-58f2b397860c"}], "security_groups": [{"name": "tempest-securitygroup--1304915397"}], "key_name": "tempest-keypair-1164837593", "user_data": "}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:53.568297 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] validate_networks() for [('6d0c04f0-74ef-4155-bac9-58f2b397860c', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:08:53.870233 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b57b9f4f-5d6d-4657-8c0f-05e74dc7ea72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:53.870849 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b57b9f4f-5d6d-4657-8c0f-05e74dc7ea72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:53.877629 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b57b9f4f-5d6d-4657-8c0f-05e74dc7ea72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:53.878081 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b57b9f4f-5d6d-4657-8c0f-05e74dc7ea72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:53.879941 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b57b9f4f-5d6d-4657-8c0f-05e74dc7ea72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:53.879941 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b57b9f4f-5d6d-4657-8c0f-05e74dc7ea72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:54.035219 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b57b9f4f-5d6d-4657-8c0f-05e74dc7ea72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:54.044586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b57b9f4f-5d6d-4657-8c0f-05e74dc7ea72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.177850 May 17 12:08:54.045088 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 167/312] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:53 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:54.235114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:08:54.235634 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:08:54.236202 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:08:54.236748 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:08:54.237229 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:08:54.245877 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:54.247114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:54.248009 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:54.248544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:54.266208 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Getting quotas for project 748d013ae6664fc79a9ac23e58f642e5. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:08:54.270634 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Getting quotas for user bb9da9200f804a4a987f2cdb49f6801d and project 748d013ae6664fc79a9ac23e58f642e5. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:08:54.282687 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:08:54.285045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:08:54.322700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-98bf0ce1-bd0f-4920-b624-d10369940b2c req-dbad2801-d7fe-44b2-b5df-889627482255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bf4c33-50e2-4e81-aa3e-98ef857d0628", "tag": "ce775399-8aaa-44e2-8bad-de44d822b044"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:54.333645 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-98bf0ce1-bd0f-4920-b624-d10369940b2c req-dbad2801-d7fe-44b2-b5df-889627482255 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:54.339123 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-98bf0ce1-bd0f-4920-b624-d10369940b2c req-dbad2801-d7fe-44b2-b5df-889627482255 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:54.353175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-98bf0ce1-bd0f-4920-b624-d10369940b2c req-dbad2801-d7fe-44b2-b5df-889627482255 service nova] Creating event network-changed:ce775399-8aaa-44e2-8bad-de44d822b044 for instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 on hv-cinder-83769 May 17 12:08:54.359973 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-98bf0ce1-bd0f-4920-b624-d10369940b2c req-dbad2801-d7fe-44b2-b5df-889627482255 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041008 May 17 12:08:54.360937 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 168/313] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:08:54.365636 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b52eec1a-e5e2-407c-bc15-ea4916580860 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.994764 May 17 12:08:54.372510 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 146/314] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:08:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:08:54.382980 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ccb4af82-beb1-4566-b8bd-10f848979bda tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:54.383730 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ccb4af82-beb1-4566-b8bd-10f848979bda tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:54.470267 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ccb4af82-beb1-4566-b8bd-10f848979bda tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:54.478510 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ccb4af82-beb1-4566-b8bd-10f848979bda tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1246 microversion: 2.1 time: 0.100496 May 17 12:08:54.479502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 169/315] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:54 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:55.061300 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d33bd1e2-21f9-4a32-80cc-0e1bba93eca7 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:55.061919 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d33bd1e2-21f9-4a32-80cc-0e1bba93eca7 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:55.069365 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d33bd1e2-21f9-4a32-80cc-0e1bba93eca7 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:55.069818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d33bd1e2-21f9-4a32-80cc-0e1bba93eca7 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:55.071095 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d33bd1e2-21f9-4a32-80cc-0e1bba93eca7 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:55.071652 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d33bd1e2-21f9-4a32-80cc-0e1bba93eca7 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:55.200877 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d33bd1e2-21f9-4a32-80cc-0e1bba93eca7 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:55.208491 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d33bd1e2-21f9-4a32-80cc-0e1bba93eca7 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.151103 May 17 12:08:55.209050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 147/316] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:55 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:55.497493 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-53f7d703-d047-47a4-a947-b2d7dd5685cf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:55.498019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-53f7d703-d047-47a4-a947-b2d7dd5685cf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:55.504051 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-53f7d703-d047-47a4-a947-b2d7dd5685cf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:55.504527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-53f7d703-d047-47a4-a947-b2d7dd5685cf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:55.505285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-53f7d703-d047-47a4-a947-b2d7dd5685cf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:55.505717 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-53f7d703-d047-47a4-a947-b2d7dd5685cf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:55.568282 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-53f7d703-d047-47a4-a947-b2d7dd5685cf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:55.575865 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-53f7d703-d047-47a4-a947-b2d7dd5685cf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1242 microversion: 2.1 time: 0.082799 May 17 12:08:55.576473 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 170/317] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:55 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:56.227240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-290abdec-1cf2-4ce1-8a9b-2edd1f319754 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:56.227850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-290abdec-1cf2-4ce1-8a9b-2edd1f319754 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:56.235195 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-290abdec-1cf2-4ce1-8a9b-2edd1f319754 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:56.235878 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-290abdec-1cf2-4ce1-8a9b-2edd1f319754 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:56.236738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-290abdec-1cf2-4ce1-8a9b-2edd1f319754 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:56.237344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-290abdec-1cf2-4ce1-8a9b-2edd1f319754 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:56.387398 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-290abdec-1cf2-4ce1-8a9b-2edd1f319754 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:56.394665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-290abdec-1cf2-4ce1-8a9b-2edd1f319754 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.171954 May 17 12:08:56.395222 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 148/318] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:56 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:56.594379 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f5470de5-9b3e-41ab-ba5b-f74bfb097840 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:56.595155 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f5470de5-9b3e-41ab-ba5b-f74bfb097840 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:56.601402 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f5470de5-9b3e-41ab-ba5b-f74bfb097840 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:56.601856 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f5470de5-9b3e-41ab-ba5b-f74bfb097840 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:56.602668 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f5470de5-9b3e-41ab-ba5b-f74bfb097840 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:56.603107 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f5470de5-9b3e-41ab-ba5b-f74bfb097840 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:56.663898 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f5470de5-9b3e-41ab-ba5b-f74bfb097840 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:56.673708 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f5470de5-9b3e-41ab-ba5b-f74bfb097840 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1298 microversion: 2.1 time: 0.084526 May 17 12:08:56.674482 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 171/319] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:56 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:57.410781 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-cb9488a8-6a2a-492f-821d-602f100b3c59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:57.411387 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-cb9488a8-6a2a-492f-821d-602f100b3c59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:57.419877 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cb9488a8-6a2a-492f-821d-602f100b3c59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:57.420337 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cb9488a8-6a2a-492f-821d-602f100b3c59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:57.421118 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cb9488a8-6a2a-492f-821d-602f100b3c59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:57.421563 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cb9488a8-6a2a-492f-821d-602f100b3c59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:57.626888 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-cb9488a8-6a2a-492f-821d-602f100b3c59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:57.634163 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-cb9488a8-6a2a-492f-821d-602f100b3c59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.227232 May 17 12:08:57.634745 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 149/320] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:57 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:57.690520 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5847f0b3-6717-4276-a991-758757d8ed9a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:57.691055 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5847f0b3-6717-4276-a991-758757d8ed9a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:57.697175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5847f0b3-6717-4276-a991-758757d8ed9a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:57.697621 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5847f0b3-6717-4276-a991-758757d8ed9a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:57.698392 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5847f0b3-6717-4276-a991-758757d8ed9a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:57.698823 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5847f0b3-6717-4276-a991-758757d8ed9a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:57.850008 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5847f0b3-6717-4276-a991-758757d8ed9a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:57.858008 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5847f0b3-6717-4276-a991-758757d8ed9a tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1372 microversion: 2.1 time: 0.171350 May 17 12:08:57.858597 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 172/321] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:57 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:58.482026 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-897397da-4966-4248-b98e-486a8a72e82b req-550d782b-8da8-4ab9-a087-cad803a4730d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce70576a-62fb-4bcc-9163-cfc28131518a", "tag": "50b482d3-375e-4f6c-9829-4b4c147b3dc5"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:08:58.496865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-897397da-4966-4248-b98e-486a8a72e82b req-550d782b-8da8-4ab9-a087-cad803a4730d service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:58.498228 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-897397da-4966-4248-b98e-486a8a72e82b req-550d782b-8da8-4ab9-a087-cad803a4730d service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:58.519702 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-897397da-4966-4248-b98e-486a8a72e82b req-550d782b-8da8-4ab9-a087-cad803a4730d service nova] Creating event network-changed:50b482d3-375e-4f6c-9829-4b4c147b3dc5 for instance ce70576a-62fb-4bcc-9163-cfc28131518a on hv-cinder-83769 May 17 12:08:58.528464 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-897397da-4966-4248-b98e-486a8a72e82b req-550d782b-8da8-4ab9-a087-cad803a4730d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052531 May 17 12:08:58.528985 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 150/322] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:08:58.651718 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-27b728b1-c5e5-4b2a-acc8-9d3e207ffbc4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:58.653121 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-27b728b1-c5e5-4b2a-acc8-9d3e207ffbc4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:58.659654 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-27b728b1-c5e5-4b2a-acc8-9d3e207ffbc4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:58.660207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-27b728b1-c5e5-4b2a-acc8-9d3e207ffbc4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:58.661275 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-27b728b1-c5e5-4b2a-acc8-9d3e207ffbc4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:58.661905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-27b728b1-c5e5-4b2a-acc8-9d3e207ffbc4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:58.812494 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-27b728b1-c5e5-4b2a-acc8-9d3e207ffbc4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:58.819791 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-27b728b1-c5e5-4b2a-acc8-9d3e207ffbc4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.172669 May 17 12:08:58.820832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 173/323] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:58 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:58.875966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-12123ee6-eb4f-4c60-be54-67e3a4aea30e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:58.876693 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-12123ee6-eb4f-4c60-be54-67e3a4aea30e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:58.882879 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12123ee6-eb4f-4c60-be54-67e3a4aea30e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:58.883331 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12123ee6-eb4f-4c60-be54-67e3a4aea30e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:58.884103 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12123ee6-eb4f-4c60-be54-67e3a4aea30e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:58.884566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12123ee6-eb4f-4c60-be54-67e3a4aea30e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:59.044721 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-12123ee6-eb4f-4c60-be54-67e3a4aea30e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:59.052122 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-12123ee6-eb4f-4c60-be54-67e3a4aea30e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1372 microversion: 2.1 time: 0.181058 May 17 12:08:59.052715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 151/324] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:58 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:08:59.837007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b5172f3c-0c29-49d7-b03f-c6d40ec5bf03 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:08:59.837749 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b5172f3c-0c29-49d7-b03f-c6d40ec5bf03 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:08:59.844772 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b5172f3c-0c29-49d7-b03f-c6d40ec5bf03 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:59.845217 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b5172f3c-0c29-49d7-b03f-c6d40ec5bf03 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:59.845988 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b5172f3c-0c29-49d7-b03f-c6d40ec5bf03 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:08:59.846427 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b5172f3c-0c29-49d7-b03f-c6d40ec5bf03 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:08:59.984452 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b5172f3c-0c29-49d7-b03f-c6d40ec5bf03 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:08:59.992344 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b5172f3c-0c29-49d7-b03f-c6d40ec5bf03 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.159021 May 17 12:08:59.992938 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 174/325] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:08:59 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:00.069169 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8ade1a2d-03dd-4930-a865-5dd6e0eb558f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:00.069777 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8ade1a2d-03dd-4930-a865-5dd6e0eb558f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:00.076830 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ade1a2d-03dd-4930-a865-5dd6e0eb558f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:00.077279 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ade1a2d-03dd-4930-a865-5dd6e0eb558f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:00.078042 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ade1a2d-03dd-4930-a865-5dd6e0eb558f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:00.078481 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ade1a2d-03dd-4930-a865-5dd6e0eb558f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:00.219805 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8ade1a2d-03dd-4930-a865-5dd6e0eb558f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:00.228497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8ade1a2d-03dd-4930-a865-5dd6e0eb558f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1372 microversion: 2.1 time: 0.163016 May 17 12:09:00.229573 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 152/326] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:00 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:01.008818 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2d4ba04e-8688-4b48-8a96-ce384ff10dfc tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:01.009428 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2d4ba04e-8688-4b48-8a96-ce384ff10dfc tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:01.016049 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2d4ba04e-8688-4b48-8a96-ce384ff10dfc tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:01.016049 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2d4ba04e-8688-4b48-8a96-ce384ff10dfc tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:01.016756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2d4ba04e-8688-4b48-8a96-ce384ff10dfc tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:01.017193 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2d4ba04e-8688-4b48-8a96-ce384ff10dfc tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:01.153288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2d4ba04e-8688-4b48-8a96-ce384ff10dfc tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:01.162169 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2d4ba04e-8688-4b48-8a96-ce384ff10dfc tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.157183 May 17 12:09:01.162759 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 175/327] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:01 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:01.245873 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-037c9a9b-c286-4d62-850d-f0494e75c783 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:01.247861 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-037c9a9b-c286-4d62-850d-f0494e75c783 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:01.254547 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-037c9a9b-c286-4d62-850d-f0494e75c783 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:01.254999 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-037c9a9b-c286-4d62-850d-f0494e75c783 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:01.255827 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-037c9a9b-c286-4d62-850d-f0494e75c783 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:01.256295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-037c9a9b-c286-4d62-850d-f0494e75c783 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:01.399244 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-037c9a9b-c286-4d62-850d-f0494e75c783 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:01.406925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-037c9a9b-c286-4d62-850d-f0494e75c783 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1372 microversion: 2.1 time: 0.164830 May 17 12:09:01.407491 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 153/328] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:01 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:02.178832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2511a909-a88a-46b8-9061-1b734e716a72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:02.179527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2511a909-a88a-46b8-9061-1b734e716a72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:02.186162 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2511a909-a88a-46b8-9061-1b734e716a72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:02.186716 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2511a909-a88a-46b8-9061-1b734e716a72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:02.187827 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2511a909-a88a-46b8-9061-1b734e716a72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:02.188373 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2511a909-a88a-46b8-9061-1b734e716a72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:02.328029 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2511a909-a88a-46b8-9061-1b734e716a72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:02.336614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2511a909-a88a-46b8-9061-1b734e716a72 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.161452 May 17 12:09:02.337263 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 176/329] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:02 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:02.423299 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-db8e451f-0503-49c3-9e6d-a76160a0be2d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:02.423917 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-db8e451f-0503-49c3-9e6d-a76160a0be2d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:02.430266 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db8e451f-0503-49c3-9e6d-a76160a0be2d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:02.430713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db8e451f-0503-49c3-9e6d-a76160a0be2d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:02.431490 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db8e451f-0503-49c3-9e6d-a76160a0be2d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:02.431931 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db8e451f-0503-49c3-9e6d-a76160a0be2d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:02.561963 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-db8e451f-0503-49c3-9e6d-a76160a0be2d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:02.569781 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-db8e451f-0503-49c3-9e6d-a76160a0be2d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1372 microversion: 2.1 time: 0.150423 May 17 12:09:02.570798 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 154/330] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:02 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:03.353285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-337fe919-4677-47a1-8d2b-8af2ebba6a0a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:03.353901 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-337fe919-4677-47a1-8d2b-8af2ebba6a0a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:03.360455 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-337fe919-4677-47a1-8d2b-8af2ebba6a0a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:03.360911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-337fe919-4677-47a1-8d2b-8af2ebba6a0a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:03.361690 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-337fe919-4677-47a1-8d2b-8af2ebba6a0a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:03.362133 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-337fe919-4677-47a1-8d2b-8af2ebba6a0a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:03.494025 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-337fe919-4677-47a1-8d2b-8af2ebba6a0a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:03.502042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-337fe919-4677-47a1-8d2b-8af2ebba6a0a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.152642 May 17 12:09:03.502620 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 177/331] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:03 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:03.586940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-812287c0-add3-4fd1-9ef3-bf4431ece642 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:03.587464 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-812287c0-add3-4fd1-9ef3-bf4431ece642 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:03.593749 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-812287c0-add3-4fd1-9ef3-bf4431ece642 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:03.594203 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-812287c0-add3-4fd1-9ef3-bf4431ece642 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:03.594973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-812287c0-add3-4fd1-9ef3-bf4431ece642 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:03.595408 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-812287c0-add3-4fd1-9ef3-bf4431ece642 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:03.967417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-812287c0-add3-4fd1-9ef3-bf4431ece642 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:03.975010 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-812287c0-add3-4fd1-9ef3-bf4431ece642 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1372 microversion: 2.1 time: 0.391948 May 17 12:09:03.975596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 155/332] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:03 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1372 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:04.518740 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0bd474bc-ed4f-4a4c-9b66-fc70cc666f04 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:04.519286 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0bd474bc-ed4f-4a4c-9b66-fc70cc666f04 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:04.525279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0bd474bc-ed4f-4a4c-9b66-fc70cc666f04 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:04.525731 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0bd474bc-ed4f-4a4c-9b66-fc70cc666f04 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:04.526500 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0bd474bc-ed4f-4a4c-9b66-fc70cc666f04 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:04.526975 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0bd474bc-ed4f-4a4c-9b66-fc70cc666f04 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:04.660155 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0bd474bc-ed4f-4a4c-9b66-fc70cc666f04 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:04.667533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0bd474bc-ed4f-4a4c-9b66-fc70cc666f04 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.152665 May 17 12:09:04.668729 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 178/333] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:04 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:04.992276 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-668dc7d7-fc1a-4809-b860-91e1d24cba21 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:04.992889 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-668dc7d7-fc1a-4809-b860-91e1d24cba21 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:04.998924 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-668dc7d7-fc1a-4809-b860-91e1d24cba21 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:04.999354 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-668dc7d7-fc1a-4809-b860-91e1d24cba21 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:05.000113 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-668dc7d7-fc1a-4809-b860-91e1d24cba21 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:05.000570 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-668dc7d7-fc1a-4809-b860-91e1d24cba21 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:05.135482 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-668dc7d7-fc1a-4809-b860-91e1d24cba21 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:05.143914 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-668dc7d7-fc1a-4809-b860-91e1d24cba21 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1372 microversion: 2.1 time: 0.155627 May 17 12:09:05.144531 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 156/334] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:04 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:05.685823 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7dbe1ee4-7e94-4f5e-84d4-1b180bffc71b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:05.686440 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7dbe1ee4-7e94-4f5e-84d4-1b180bffc71b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:05.693209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7dbe1ee4-7e94-4f5e-84d4-1b180bffc71b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:05.693831 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7dbe1ee4-7e94-4f5e-84d4-1b180bffc71b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:05.694859 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7dbe1ee4-7e94-4f5e-84d4-1b180bffc71b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:05.695645 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7dbe1ee4-7e94-4f5e-84d4-1b180bffc71b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:05.844429 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7dbe1ee4-7e94-4f5e-84d4-1b180bffc71b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:05.851668 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7dbe1ee4-7e94-4f5e-84d4-1b180bffc71b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.170763 May 17 12:09:05.852259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 179/335] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:05 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:06.160959 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4b2c751a-afd6-4078-ac5e-b0b6db560ba8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:06.161565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4b2c751a-afd6-4078-ac5e-b0b6db560ba8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:06.168700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b2c751a-afd6-4078-ac5e-b0b6db560ba8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:06.169146 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b2c751a-afd6-4078-ac5e-b0b6db560ba8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:06.169913 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b2c751a-afd6-4078-ac5e-b0b6db560ba8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:06.170341 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b2c751a-afd6-4078-ac5e-b0b6db560ba8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:06.299758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4b2c751a-afd6-4078-ac5e-b0b6db560ba8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:06.307022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4b2c751a-afd6-4078-ac5e-b0b6db560ba8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1372 microversion: 2.1 time: 0.150067 May 17 12:09:06.307596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 157/336] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:06 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:06.747146 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-7e3f94b2-f289-4dea-a4e6-fd06c01325d7 req-e8c6a8ef-5542-4616-b97e-aab1455b7546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce70576a-62fb-4bcc-9163-cfc28131518a", "name": "network-vif-plugged", "status": "completed", "tag": "50b482d3-375e-4f6c-9829-4b4c147b3dc5"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:09:06.755771 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-7e3f94b2-f289-4dea-a4e6-fd06c01325d7 req-e8c6a8ef-5542-4616-b97e-aab1455b7546 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:06.756545 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-7e3f94b2-f289-4dea-a4e6-fd06c01325d7 req-e8c6a8ef-5542-4616-b97e-aab1455b7546 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:06.769326 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-7e3f94b2-f289-4dea-a4e6-fd06c01325d7 req-e8c6a8ef-5542-4616-b97e-aab1455b7546 service nova] Creating event network-vif-plugged:50b482d3-375e-4f6c-9829-4b4c147b3dc5 for instance ce70576a-62fb-4bcc-9163-cfc28131518a on hv-cinder-83769 May 17 12:09:06.774380 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-7e3f94b2-f289-4dea-a4e6-fd06c01325d7 req-e8c6a8ef-5542-4616-b97e-aab1455b7546 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031912 May 17 12:09:06.775010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 180/337] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:09:06.869195 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-bf55a160-6b1d-41f4-bfc2-0c28d1d5fbe5 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:06.869979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-bf55a160-6b1d-41f4-bfc2-0c28d1d5fbe5 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:06.877043 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bf55a160-6b1d-41f4-bfc2-0c28d1d5fbe5 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:06.878283 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bf55a160-6b1d-41f4-bfc2-0c28d1d5fbe5 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:06.879425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bf55a160-6b1d-41f4-bfc2-0c28d1d5fbe5 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:06.880333 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bf55a160-6b1d-41f4-bfc2-0c28d1d5fbe5 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:07.174098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-bf55a160-6b1d-41f4-bfc2-0c28d1d5fbe5 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:07.181791 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-bf55a160-6b1d-41f4-bfc2-0c28d1d5fbe5 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.316752 May 17 12:09:07.182368 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 158/338] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:06 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:09:07.325178 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-dbc1b64b-d1a1-44c6-8be2-df24fb8daa72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:07.325879 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-dbc1b64b-d1a1-44c6-8be2-df24fb8daa72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:07.331834 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbc1b64b-d1a1-44c6-8be2-df24fb8daa72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:07.332314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbc1b64b-d1a1-44c6-8be2-df24fb8daa72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:07.333086 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbc1b64b-d1a1-44c6-8be2-df24fb8daa72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:07.333528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbc1b64b-d1a1-44c6-8be2-df24fb8daa72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:07.463444 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-dbc1b64b-d1a1-44c6-8be2-df24fb8daa72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:07.471728 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-dbc1b64b-d1a1-44c6-8be2-df24fb8daa72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1372 microversion: 2.1 time: 0.150736 May 17 12:09:07.472508 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 181/339] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:07 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:08.199028 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8c5fadf7-75d9-4773-9a5e-f7ed6d5fab66 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:08.200374 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8c5fadf7-75d9-4773-9a5e-f7ed6d5fab66 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:08.206722 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c5fadf7-75d9-4773-9a5e-f7ed6d5fab66 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:08.207169 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c5fadf7-75d9-4773-9a5e-f7ed6d5fab66 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:08.207937 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c5fadf7-75d9-4773-9a5e-f7ed6d5fab66 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:08.208398 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c5fadf7-75d9-4773-9a5e-f7ed6d5fab66 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:08.351114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8c5fadf7-75d9-4773-9a5e-f7ed6d5fab66 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:08.360920 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8c5fadf7-75d9-4773-9a5e-f7ed6d5fab66 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.165884 May 17 12:09:08.361681 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 159/340] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:08 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:08.488776 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2b713458-2d8d-453a-961b-ca2b5ddaac20 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:08.489422 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2b713458-2d8d-453a-961b-ca2b5ddaac20 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:08.495183 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2b713458-2d8d-453a-961b-ca2b5ddaac20 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:08.495635 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2b713458-2d8d-453a-961b-ca2b5ddaac20 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:08.497059 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2b713458-2d8d-453a-961b-ca2b5ddaac20 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:08.497496 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2b713458-2d8d-453a-961b-ca2b5ddaac20 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:08.642516 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d459d022-74b7-4387-a87c-79516bb4c140 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "572f46a9-b90a-4514-b26b-598762af4b85", "device": "/dev/sdb"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:09:08.644532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d459d022-74b7-4387-a87c-79516bb4c140 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:08.651878 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d459d022-74b7-4387-a87c-79516bb4c140 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:08.653523 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d459d022-74b7-4387-a87c-79516bb4c140 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:08.654505 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d459d022-74b7-4387-a87c-79516bb4c140 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:08.654946 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d459d022-74b7-4387-a87c-79516bb4c140 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:08.659684 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2b713458-2d8d-453a-961b-ca2b5ddaac20 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:08.672229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2b713458-2d8d-453a-961b-ca2b5ddaac20 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1372 microversion: 2.1 time: 0.187296 May 17 12:09:08.683861 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 182/341] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:08 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:08.959835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d459d022-74b7-4387-a87c-79516bb4c140 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "POST /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321366 May 17 12:09:08.960518 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 160/342] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:09:08 2022] POST /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:09:09.378366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5e026114-fa1e-4536-ab4a-593f6cd639ea tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:09.379103 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5e026114-fa1e-4536-ab4a-593f6cd639ea tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:09.385161 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5e026114-fa1e-4536-ab4a-593f6cd639ea tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:09.385860 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5e026114-fa1e-4536-ab4a-593f6cd639ea tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:09.386738 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5e026114-fa1e-4536-ab4a-593f6cd639ea tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:09.387376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5e026114-fa1e-4536-ab4a-593f6cd639ea tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:09.535196 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5e026114-fa1e-4536-ab4a-593f6cd639ea tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:09.543538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5e026114-fa1e-4536-ab4a-593f6cd639ea tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.168736 May 17 12:09:09.544311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 183/343] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:09 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:09.690906 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f90f4962-9236-4e3e-baf3-88d0f71a21dd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:09.692259 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f90f4962-9236-4e3e-baf3-88d0f71a21dd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:09.698889 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f90f4962-9236-4e3e-baf3-88d0f71a21dd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:09.700363 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f90f4962-9236-4e3e-baf3-88d0f71a21dd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:09.701192 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f90f4962-9236-4e3e-baf3-88d0f71a21dd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:09.701640 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f90f4962-9236-4e3e-baf3-88d0f71a21dd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:09.835626 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f90f4962-9236-4e3e-baf3-88d0f71a21dd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:09.847322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f90f4962-9236-4e3e-baf3-88d0f71a21dd tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1567 microversion: 2.1 time: 0.157688 May 17 12:09:09.847322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 161/344] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:09 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:09.861504 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4f0563d4-f4e5-4e81-abf5-c3f45dea27f0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:09.862083 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4f0563d4-f4e5-4e81-abf5-c3f45dea27f0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:09.870090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f0563d4-f4e5-4e81-abf5-c3f45dea27f0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:09.870626 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f0563d4-f4e5-4e81-abf5-c3f45dea27f0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:09.871559 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f0563d4-f4e5-4e81-abf5-c3f45dea27f0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:09.872168 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f0563d4-f4e5-4e81-abf5-c3f45dea27f0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:09.956435 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4f0563d4-f4e5-4e81-abf5-c3f45dea27f0 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098941 May 17 12:09:09.957054 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 184/345] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 17 12:09:09 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:09:10.563159 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-78718fe4-b422-43a6-9df9-88e09bde8016 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:10.564257 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-78718fe4-b422-43a6-9df9-88e09bde8016 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:10.571051 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-78718fe4-b422-43a6-9df9-88e09bde8016 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:10.571754 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-78718fe4-b422-43a6-9df9-88e09bde8016 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:10.572804 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-78718fe4-b422-43a6-9df9-88e09bde8016 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:10.573332 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-78718fe4-b422-43a6-9df9-88e09bde8016 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:10.814074 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-78718fe4-b422-43a6-9df9-88e09bde8016 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:10.822174 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-78718fe4-b422-43a6-9df9-88e09bde8016 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.263173 May 17 12:09:10.823362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 162/346] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:10 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:09:10.998584 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-37e37c74-6f02-4e1f-93b5-8b1efc31c474 req-d4fdbd86-cabc-4672-b293-df7f78c0dd5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce70576a-62fb-4bcc-9163-cfc28131518a", "tag": "50b482d3-375e-4f6c-9829-4b4c147b3dc5"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:09:11.008721 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-37e37c74-6f02-4e1f-93b5-8b1efc31c474 req-d4fdbd86-cabc-4672-b293-df7f78c0dd5a service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:11.009360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-37e37c74-6f02-4e1f-93b5-8b1efc31c474 req-d4fdbd86-cabc-4672-b293-df7f78c0dd5a service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:11.021229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-37e37c74-6f02-4e1f-93b5-8b1efc31c474 req-d4fdbd86-cabc-4672-b293-df7f78c0dd5a service nova] Creating event network-changed:50b482d3-375e-4f6c-9829-4b4c147b3dc5 for instance ce70576a-62fb-4bcc-9163-cfc28131518a on hv-cinder-83769 May 17 12:09:11.027734 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-37e37c74-6f02-4e1f-93b5-8b1efc31c474 req-d4fdbd86-cabc-4672-b293-df7f78c0dd5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032689 May 17 12:09:11.028953 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 185/347] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:09:11.049970 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-9fb07dd8-200d-40f2-abb6-46d2f1d13279 req-59b53145-9518-457c-adc1-c768eac028ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bf4c33-50e2-4e81-aa3e-98ef857d0628", "name": "network-vif-plugged", "status": "completed", "tag": "ce775399-8aaa-44e2-8bad-de44d822b044"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:09:11.060053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-9fb07dd8-200d-40f2-abb6-46d2f1d13279 req-59b53145-9518-457c-adc1-c768eac028ee service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:11.060720 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-9fb07dd8-200d-40f2-abb6-46d2f1d13279 req-59b53145-9518-457c-adc1-c768eac028ee service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:11.099914 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-9fb07dd8-200d-40f2-abb6-46d2f1d13279 req-59b53145-9518-457c-adc1-c768eac028ee service nova] Creating event network-vif-plugged:ce775399-8aaa-44e2-8bad-de44d822b044 for instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 on hv-cinder-83769 May 17 12:09:11.110330 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-9fb07dd8-200d-40f2-abb6-46d2f1d13279 req-59b53145-9518-457c-adc1-c768eac028ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064267 May 17 12:09:11.111875 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 163/348] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:09:11.839333 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-eb089748-ef38-43f7-a464-e4f06310903b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:11.840776 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-eb089748-ef38-43f7-a464-e4f06310903b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:11.846971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb089748-ef38-43f7-a464-e4f06310903b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:11.847416 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb089748-ef38-43f7-a464-e4f06310903b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:11.848174 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb089748-ef38-43f7-a464-e4f06310903b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:11.848654 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb089748-ef38-43f7-a464-e4f06310903b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:11.982666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-eb089748-ef38-43f7-a464-e4f06310903b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:11.990325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-eb089748-ef38-43f7-a464-e4f06310903b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.155155 May 17 12:09:11.990911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 186/349] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:11 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:13.007289 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3627ba1f-31f8-47d0-841c-1b475bd19968 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:13.008009 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-3627ba1f-31f8-47d0-841c-1b475bd19968 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:13.014610 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3627ba1f-31f8-47d0-841c-1b475bd19968 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:13.015065 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3627ba1f-31f8-47d0-841c-1b475bd19968 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:13.015837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3627ba1f-31f8-47d0-841c-1b475bd19968 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:13.016303 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3627ba1f-31f8-47d0-841c-1b475bd19968 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:13.144192 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3627ba1f-31f8-47d0-841c-1b475bd19968 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:13.151460 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-3627ba1f-31f8-47d0-841c-1b475bd19968 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1259 microversion: 2.1 time: 0.148382 May 17 12:09:13.152537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 164/350] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:13 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:14.168837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2c5ffb0a-e904-43f0-a41a-037ed6a59275 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:14.169405 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2c5ffb0a-e904-43f0-a41a-037ed6a59275 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:14.176861 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2c5ffb0a-e904-43f0-a41a-037ed6a59275 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:14.177736 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2c5ffb0a-e904-43f0-a41a-037ed6a59275 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:14.178654 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2c5ffb0a-e904-43f0-a41a-037ed6a59275 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:14.179217 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2c5ffb0a-e904-43f0-a41a-037ed6a59275 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:14.318872 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2c5ffb0a-e904-43f0-a41a-037ed6a59275 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:14.326615 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2c5ffb0a-e904-43f0-a41a-037ed6a59275 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1442 microversion: 2.1 time: 0.161562 May 17 12:09:14.327142 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 187/351] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:14 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:14.342943 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-93bf25c4-c489-4e97-8607-037a6e89f344 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:14.343557 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-93bf25c4-c489-4e97-8607-037a6e89f344 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:14.350137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93bf25c4-c489-4e97-8607-037a6e89f344 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:14.350589 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93bf25c4-c489-4e97-8607-037a6e89f344 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:14.351360 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93bf25c4-c489-4e97-8607-037a6e89f344 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:14.351796 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93bf25c4-c489-4e97-8607-037a6e89f344 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:14.493819 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-93bf25c4-c489-4e97-8607-037a6e89f344 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:14.502060 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-93bf25c4-c489-4e97-8607-037a6e89f344 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1442 microversion: 2.1 time: 0.162846 May 17 12:09:14.502693 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 165/352] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:14 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1442 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:16.552138 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-0fed6e88-7a5a-4473-861f-f8c48c307d7a req-db025059-19ae-4426-95dd-b506148d1266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bf4c33-50e2-4e81-aa3e-98ef857d0628", "tag": "ce775399-8aaa-44e2-8bad-de44d822b044"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:09:16.561329 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-0fed6e88-7a5a-4473-861f-f8c48c307d7a req-db025059-19ae-4426-95dd-b506148d1266 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:16.561860 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-0fed6e88-7a5a-4473-861f-f8c48c307d7a req-db025059-19ae-4426-95dd-b506148d1266 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:16.573096 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-0fed6e88-7a5a-4473-861f-f8c48c307d7a req-db025059-19ae-4426-95dd-b506148d1266 service nova] Creating event network-changed:ce775399-8aaa-44e2-8bad-de44d822b044 for instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 on hv-cinder-83769 May 17 12:09:16.578854 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-0fed6e88-7a5a-4473-861f-f8c48c307d7a req-db025059-19ae-4426-95dd-b506148d1266 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031010 May 17 12:09:16.579447 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 188/353] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:09:38.778689 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0b2efcb6-b0ef-472b-90ae-33a33cfafa48 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:38.779340 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0b2efcb6-b0ef-472b-90ae-33a33cfafa48 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:38.785543 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0b2efcb6-b0ef-472b-90ae-33a33cfafa48 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:38.786002 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0b2efcb6-b0ef-472b-90ae-33a33cfafa48 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:38.786794 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0b2efcb6-b0ef-472b-90ae-33a33cfafa48 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:38.787219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0b2efcb6-b0ef-472b-90ae-33a33cfafa48 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:38.909438 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-0b2efcb6-b0ef-472b-90ae-33a33cfafa48 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lazy-loading 'services' on Instance uuid 07b13499-6633-4afb-9e7d-535aa76a374d {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:09:39.018266 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0b2efcb6-b0ef-472b-90ae-33a33cfafa48 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "DELETE /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d/os-volume_attachments/572f46a9-b90a-4514-b26b-598762af4b85" status: 202 len: 0 microversion: 2.1 time: 0.243360 May 17 12:09:39.018804 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 166/354] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:09:38 2022] DELETE /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d/os-volume_attachments/572f46a9-b90a-4514-b26b-598762af4b85 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:09:41.182301 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d5cc5c61-30ba-46e5-a6b4-915e11e82d1f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:41.182891 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d5cc5c61-30ba-46e5-a6b4-915e11e82d1f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:41.189729 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d5cc5c61-30ba-46e5-a6b4-915e11e82d1f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:41.190185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d5cc5c61-30ba-46e5-a6b4-915e11e82d1f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:41.190985 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d5cc5c61-30ba-46e5-a6b4-915e11e82d1f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:41.191425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d5cc5c61-30ba-46e5-a6b4-915e11e82d1f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:41.214957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d5cc5c61-30ba-46e5-a6b4-915e11e82d1f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:09:41.294632 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d5cc5c61-30ba-46e5-a6b4-915e11e82d1f tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "DELETE /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 204 len: 0 microversion: 2.1 time: 0.115514 May 17 12:09:41.295350 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 189/355] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:09:41 2022] DELETE /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:09:41.304172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-98e218c6-55e8-4a7c-97f4-013e2fbfa84a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:41.304907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-98e218c6-55e8-4a7c-97f4-013e2fbfa84a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:41.314866 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98e218c6-55e8-4a7c-97f4-013e2fbfa84a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:41.315322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98e218c6-55e8-4a7c-97f4-013e2fbfa84a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:41.316113 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98e218c6-55e8-4a7c-97f4-013e2fbfa84a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:41.316762 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98e218c6-55e8-4a7c-97f4-013e2fbfa84a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:41.442280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-98e218c6-55e8-4a7c-97f4-013e2fbfa84a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:41.450009 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-98e218c6-55e8-4a7c-97f4-013e2fbfa84a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1513 microversion: 2.1 time: 0.150069 May 17 12:09:41.450687 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 167/356] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:41 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:42.467948 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e8dfd9ff-ec58-4068-95ff-bbc982cb9a97 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:42.468667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e8dfd9ff-ec58-4068-95ff-bbc982cb9a97 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:42.474587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8dfd9ff-ec58-4068-95ff-bbc982cb9a97 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:42.475028 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8dfd9ff-ec58-4068-95ff-bbc982cb9a97 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:42.475783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8dfd9ff-ec58-4068-95ff-bbc982cb9a97 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:42.476241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8dfd9ff-ec58-4068-95ff-bbc982cb9a97 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:42.607695 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e8dfd9ff-ec58-4068-95ff-bbc982cb9a97 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:42.614865 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e8dfd9ff-ec58-4068-95ff-bbc982cb9a97 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1513 microversion: 2.1 time: 0.151813 May 17 12:09:42.615423 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 190/357] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:42 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:43.630822 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b531740a-dcd8-4076-b644-f623798faea2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:43.631439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b531740a-dcd8-4076-b644-f623798faea2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:43.637980 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b531740a-dcd8-4076-b644-f623798faea2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:43.638447 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b531740a-dcd8-4076-b644-f623798faea2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:43.639241 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b531740a-dcd8-4076-b644-f623798faea2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:43.639669 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b531740a-dcd8-4076-b644-f623798faea2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:43.776051 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b531740a-dcd8-4076-b644-f623798faea2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:43.784440 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b531740a-dcd8-4076-b644-f623798faea2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1513 microversion: 2.1 time: 0.157238 May 17 12:09:43.784738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 168/358] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:43 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:44.353549 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-8573da65-b028-4e3e-8413-55c9152d0a8f req-593ac39e-faaa-468f-b7a8-aa26d9c6841b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b13499-6633-4afb-9e7d-535aa76a374d", "name": "network-vif-deleted", "tag": "9f484cd3-9b81-441e-94e1-4b0c6fac9bf2"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:09:44.362175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-8573da65-b028-4e3e-8413-55c9152d0a8f req-593ac39e-faaa-468f-b7a8-aa26d9c6841b service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:44.362612 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-8573da65-b028-4e3e-8413-55c9152d0a8f req-593ac39e-faaa-468f-b7a8-aa26d9c6841b service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:44.373580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-8573da65-b028-4e3e-8413-55c9152d0a8f req-593ac39e-faaa-468f-b7a8-aa26d9c6841b service nova] Creating event network-vif-deleted:9f484cd3-9b81-441e-94e1-4b0c6fac9bf2 for instance 07b13499-6633-4afb-9e7d-535aa76a374d on hv-cinder-83769 May 17 12:09:44.378341 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-8573da65-b028-4e3e-8413-55c9152d0a8f req-593ac39e-faaa-468f-b7a8-aa26d9c6841b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028311 May 17 12:09:44.379048 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 191/359] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:09:44.801034 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:44.801654 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:44.808048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:44.808528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:44.809305 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:44.810579 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:44.843514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:44.843989 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:44.844450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lazy-loading 'fault' on Instance uuid 07b13499-6633-4afb-9e7d-535aa76a374d {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:09:44.899416 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:44.906896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a9842998-0c87-4b93-bfb3-be6758773d05 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 200 len: 1308 microversion: 2.1 time: 0.109798 May 17 12:09:44.907469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 169/360] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:44 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:09:45.924661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-262b2a0d-af58-4e0a-b04c-4e6c4bfb006b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:45.925360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-262b2a0d-af58-4e0a-b04c-4e6c4bfb006b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 07b13499-6633-4afb-9e7d-535aa76a374d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:45.931663 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-262b2a0d-af58-4e0a-b04c-4e6c4bfb006b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:45.932108 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-262b2a0d-af58-4e0a-b04c-4e6c4bfb006b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:45.932892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-262b2a0d-af58-4e0a-b04c-4e6c4bfb006b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:45.933326 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-262b2a0d-af58-4e0a-b04c-4e6c4bfb006b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:45.946917 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-262b2a0d-af58-4e0a-b04c-4e6c4bfb006b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] HTTP exception thrown: Instance 07b13499-6633-4afb-9e7d-535aa76a374d could not be found. May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-262b2a0d-af58-4e0a-b04c-4e6c4bfb006b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Request method failure captured: May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d HTTP/1.1 May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig5AkmgOYbf1y8-9fD4QdCqatvM4ybtn3_9EaxCABSxV40zI5N8PTD123g861tLe2WKZUXsugjlu2FojhIZZ5xiGSduGjjKUZ64LbJX5VswUP-x8rXktCsRIJdpsy2THC6PUOyV5pzf2C_BoJ_dKFj1UVJJSGZB64sGg0G_xpVhhL3gk May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: a69c8441974b4749bd43a2ccf3629332 May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2056856710 May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:09:45.948563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a69c8441974b4749bd43a2ccf3629332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a69c8441974b4749bd43a2ccf3629332", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a69c8441974b4749bd43a2ccf3629332"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a69c8441974b4749bd43a2ccf3629332"}]}] May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-VolumesSnapshotTestJSON-2056856710 May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: a69c8441974b4749bd43a2ccf3629332 May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2056856710 May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-VolumesSnapshotTestJSON-2056856710-project May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: f45cfe92bd7641b6b78b99938767bc32 May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-VolumesSnapshotTestJSON-2056856710-project May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance 07b13499-6633-4afb-9e7d-535aa76a374d could not be found. May 17 12:09:45.950666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '07b13499-6633-4afb-9e7d-535aa76a374d'} May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07b13499-6633-4afb-9e7d-535aa76a374d could not be found. May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:09:45.951599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07b13499-6633-4afb-9e7d-535aa76a374d could not be found. May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07b13499-6633-4afb-9e7d-535aa76a374d could not be found. May 17 12:09:45.953064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:09:45.954414 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-262b2a0d-af58-4e0a-b04c-4e6c4bfb006b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Returning 404 to user: Instance 07b13499-6633-4afb-9e7d-535aa76a374d could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:09:45.954414 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-262b2a0d-af58-4e0a-b04c-4e6c4bfb006b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d" status: 404 len: 111 microversion: 2.1 time: 0.029527 May 17 12:09:45.954414 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 192/361] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:45 2022] GET /compute/v2.1/servers/07b13499-6633-4afb-9e7d-535aa76a374d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 12:09:49.964551 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:09:49.965140 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Tue May 17 12:09:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:09:57.840271 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-788749121", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "networks": [{"uuid": "df2d2de6-ecb9-4187-b033-becb493fafc0"}]}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:09:57.890999 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] validate_networks() for [('df2d2de6-ecb9-4187-b033-becb493fafc0', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:09:58.222632 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:09:58.223053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:09:58.223524 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:09:58.223931 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:09:58.224369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:09:58.232892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:58.233337 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:58.234126 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:58.234558 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:58.251230 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Getting quotas for project a69c8441974b4749bd43a2ccf3629332. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:09:58.255060 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Getting quotas for user f45cfe92bd7641b6b78b99938767bc32 and project a69c8441974b4749bd43a2ccf3629332. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:09:58.266102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:09:58.268306 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:09:58.312670 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-9ae0e085-1ea1-4935-ab51-d0ae59a9090e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.476187 May 17 12:09:58.313599 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 170/362] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:09:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:09:58.327742 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2941a048-3734-40df-bcb0-f5b4c6935483 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:58.328389 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2941a048-3734-40df-bcb0-f5b4c6935483 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:58.381119 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2941a048-3734-40df-bcb0-f5b4c6935483 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:58.388719 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2941a048-3734-40df-bcb0-f5b4c6935483 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1218 microversion: 2.1 time: 0.068409 May 17 12:09:58.389307 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 193/363] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:58 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:09:59.407025 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f3f6f9e7-11c6-42b9-8b6f-21b7a0b1df0c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:09:59.407632 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f3f6f9e7-11c6-42b9-8b6f-21b7a0b1df0c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:09:59.415186 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f3f6f9e7-11c6-42b9-8b6f-21b7a0b1df0c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:59.415638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f3f6f9e7-11c6-42b9-8b6f-21b7a0b1df0c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:59.416463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f3f6f9e7-11c6-42b9-8b6f-21b7a0b1df0c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:09:59.416886 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f3f6f9e7-11c6-42b9-8b6f-21b7a0b1df0c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:09:59.497977 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f3f6f9e7-11c6-42b9-8b6f-21b7a0b1df0c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:09:59.506133 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f3f6f9e7-11c6-42b9-8b6f-21b7a0b1df0c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1278 microversion: 2.1 time: 0.104308 May 17 12:09:59.507421 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 171/364] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:09:59 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1278 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:00.523717 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2ae92269-3b80-437c-9097-5b0070687dde tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:00.524962 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2ae92269-3b80-437c-9097-5b0070687dde tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:00.532695 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2ae92269-3b80-437c-9097-5b0070687dde tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:00.533419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2ae92269-3b80-437c-9097-5b0070687dde tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:00.534288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2ae92269-3b80-437c-9097-5b0070687dde tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:00.534793 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2ae92269-3b80-437c-9097-5b0070687dde tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:00.663902 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2ae92269-3b80-437c-9097-5b0070687dde tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:00.673717 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2ae92269-3b80-437c-9097-5b0070687dde tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1318 microversion: 2.1 time: 0.153921 May 17 12:10:00.674290 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 194/365] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:00 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:00.712379 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-9ea6e805-1d2a-4988-bfe8-5815cc5ad599 req-f5f4203d-5e40-4ea4-94df-265498c5d913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92cb2fa3-d151-4e91-8621-eff4576bd14b", "tag": "6ad7b5f7-23e1-4c95-a6e0-f49e836af232"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:00.723435 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-9ea6e805-1d2a-4988-bfe8-5815cc5ad599 req-f5f4203d-5e40-4ea4-94df-265498c5d913 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:00.723981 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-9ea6e805-1d2a-4988-bfe8-5815cc5ad599 req-f5f4203d-5e40-4ea4-94df-265498c5d913 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:00.735843 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-9ea6e805-1d2a-4988-bfe8-5815cc5ad599 req-f5f4203d-5e40-4ea4-94df-265498c5d913 service nova] Creating event network-changed:6ad7b5f7-23e1-4c95-a6e0-f49e836af232 for instance 92cb2fa3-d151-4e91-8621-eff4576bd14b on hv-cinder-83769 May 17 12:10:00.740617 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-9ea6e805-1d2a-4988-bfe8-5815cc5ad599 req-f5f4203d-5e40-4ea4-94df-265498c5d913 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031869 May 17 12:10:00.741204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 172/366] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:10:01.691158 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c078780d-badd-4028-a6a1-6a2c867ea721 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:01.691761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c078780d-badd-4028-a6a1-6a2c867ea721 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:01.698011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c078780d-badd-4028-a6a1-6a2c867ea721 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:01.698456 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c078780d-badd-4028-a6a1-6a2c867ea721 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:01.699216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c078780d-badd-4028-a6a1-6a2c867ea721 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:01.699645 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c078780d-badd-4028-a6a1-6a2c867ea721 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:01.834113 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c078780d-badd-4028-a6a1-6a2c867ea721 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:01.841833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c078780d-badd-4028-a6a1-6a2c867ea721 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1318 microversion: 2.1 time: 0.154806 May 17 12:10:01.842392 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 195/367] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:01 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:02.859194 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fb2df407-1af6-4a1b-99e0-e104a37e6e2b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:02.859818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fb2df407-1af6-4a1b-99e0-e104a37e6e2b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:02.865968 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb2df407-1af6-4a1b-99e0-e104a37e6e2b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:02.866424 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb2df407-1af6-4a1b-99e0-e104a37e6e2b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:02.867192 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb2df407-1af6-4a1b-99e0-e104a37e6e2b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:02.867634 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fb2df407-1af6-4a1b-99e0-e104a37e6e2b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:02.996086 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-fb2df407-1af6-4a1b-99e0-e104a37e6e2b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:03.003871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fb2df407-1af6-4a1b-99e0-e104a37e6e2b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1318 microversion: 2.1 time: 0.149518 May 17 12:10:03.004463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 173/368] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:02 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:04.020106 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8422dec6-4ce1-48ce-b616-9b4a6cf233f5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:04.020740 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8422dec6-4ce1-48ce-b616-9b4a6cf233f5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:04.026585 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8422dec6-4ce1-48ce-b616-9b4a6cf233f5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:04.027029 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8422dec6-4ce1-48ce-b616-9b4a6cf233f5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:04.027783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8422dec6-4ce1-48ce-b616-9b4a6cf233f5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:04.028824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8422dec6-4ce1-48ce-b616-9b4a6cf233f5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:04.152332 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8422dec6-4ce1-48ce-b616-9b4a6cf233f5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:04.159631 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8422dec6-4ce1-48ce-b616-9b4a6cf233f5 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1318 microversion: 2.1 time: 0.143348 May 17 12:10:04.160202 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 196/369] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:04 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:04.810123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-758cd926-f1a4-4a6c-9647-d1e527d29089 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:04.810682 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-758cd926-f1a4-4a6c-9647-d1e527d29089 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:04.816545 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-758cd926-f1a4-4a6c-9647-d1e527d29089 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:04.816987 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-758cd926-f1a4-4a6c-9647-d1e527d29089 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:04.817757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-758cd926-f1a4-4a6c-9647-d1e527d29089 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:04.818187 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-758cd926-f1a4-4a6c-9647-d1e527d29089 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:04.841998 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-758cd926-f1a4-4a6c-9647-d1e527d29089 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/ips" status: 200 len: 151 microversion: 2.20 time: 0.035948 May 17 12:10:04.842573 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 174/370] 10.222.0.58 () {60 vars in 1288 bytes} [Tue May 17 12:10:04 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 12:10:05.176385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-95a4cce0-0da0-465d-b373-b19fcfa368d9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:05.177018 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-95a4cce0-0da0-465d-b373-b19fcfa368d9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:05.182913 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95a4cce0-0da0-465d-b373-b19fcfa368d9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:05.183346 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95a4cce0-0da0-465d-b373-b19fcfa368d9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:05.184147 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95a4cce0-0da0-465d-b373-b19fcfa368d9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:05.185316 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95a4cce0-0da0-465d-b373-b19fcfa368d9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:05.314006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-95a4cce0-0da0-465d-b373-b19fcfa368d9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:05.321429 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-95a4cce0-0da0-465d-b373-b19fcfa368d9 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1318 microversion: 2.1 time: 0.148658 May 17 12:10:05.321990 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 197/371] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:05 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:06.338204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1174b622-38bc-4257-bae1-c108f5b7dbd8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:06.338821 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1174b622-38bc-4257-bae1-c108f5b7dbd8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:06.345842 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1174b622-38bc-4257-bae1-c108f5b7dbd8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:06.346296 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1174b622-38bc-4257-bae1-c108f5b7dbd8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:06.347063 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1174b622-38bc-4257-bae1-c108f5b7dbd8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:06.347502 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1174b622-38bc-4257-bae1-c108f5b7dbd8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:06.477474 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1174b622-38bc-4257-bae1-c108f5b7dbd8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:06.484893 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1174b622-38bc-4257-bae1-c108f5b7dbd8 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1318 microversion: 2.1 time: 0.150453 May 17 12:10:06.485469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 175/372] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:06 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:07.407865 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3673e372-6fcc-44c6-a70a-246aa9be5ce4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:07.408498 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3673e372-6fcc-44c6-a70a-246aa9be5ce4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:07.414224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3673e372-6fcc-44c6-a70a-246aa9be5ce4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:07.414666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3673e372-6fcc-44c6-a70a-246aa9be5ce4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:07.415425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3673e372-6fcc-44c6-a70a-246aa9be5ce4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:07.415852 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3673e372-6fcc-44c6-a70a-246aa9be5ce4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:07.438125 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.objects.instance [None req-3673e372-6fcc-44c6-a70a-246aa9be5ce4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lazy-loading 'flavor' on Instance uuid d883f923-082e-4ee1-ba3e-0975ba2d7409 {{(pid=117114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:10:07.502888 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-dfb98065-a047-4a4e-976f-25b051d9e73c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:07.503590 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-dfb98065-a047-4a4e-976f-25b051d9e73c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:07.510381 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dfb98065-a047-4a4e-976f-25b051d9e73c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:07.510892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dfb98065-a047-4a4e-976f-25b051d9e73c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:07.511751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dfb98065-a047-4a4e-976f-25b051d9e73c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:07.512780 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dfb98065-a047-4a4e-976f-25b051d9e73c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:07.641532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-dfb98065-a047-4a4e-976f-25b051d9e73c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:07.650185 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-dfb98065-a047-4a4e-976f-25b051d9e73c tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1318 microversion: 2.1 time: 0.151124 May 17 12:10:07.651015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 176/373] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:07 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:10:07.692282 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3673e372-6fcc-44c6-a70a-246aa9be5ce4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "POST /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/action" status: 202 len: 0 microversion: 2.20 time: 0.288146 May 17 12:10:07.693057 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 198/374] 10.222.0.58 () {62 vars in 1318 bytes} [Tue May 17 12:10:07 2022] POST /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 12:10:07.701850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-79cb9b71-9656-4417-a0d6-1d7a7bc0f167 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:07.702582 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-79cb9b71-9656-4417-a0d6-1d7a7bc0f167 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:07.708751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-79cb9b71-9656-4417-a0d6-1d7a7bc0f167 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:07.709311 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-79cb9b71-9656-4417-a0d6-1d7a7bc0f167 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:07.710219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-79cb9b71-9656-4417-a0d6-1d7a7bc0f167 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:07.710664 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-79cb9b71-9656-4417-a0d6-1d7a7bc0f167 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:07.841647 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-79cb9b71-9656-4417-a0d6-1d7a7bc0f167 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:07.849509 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-79cb9b71-9656-4417-a0d6-1d7a7bc0f167 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:07.851061 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-79cb9b71-9656-4417-a0d6-1d7a7bc0f167 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:07.852279 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-79cb9b71-9656-4417-a0d6-1d7a7bc0f167 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.154838 May 17 12:10:07.852855 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 177/375] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:07 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:08.668786 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-eea20cb3-c1f3-4885-8660-758d46164c1b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:08.669479 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-eea20cb3-c1f3-4885-8660-758d46164c1b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:08.675887 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eea20cb3-c1f3-4885-8660-758d46164c1b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:08.676358 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eea20cb3-c1f3-4885-8660-758d46164c1b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:08.677135 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eea20cb3-c1f3-4885-8660-758d46164c1b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:08.677566 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eea20cb3-c1f3-4885-8660-758d46164c1b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:08.806740 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-eea20cb3-c1f3-4885-8660-758d46164c1b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:08.814769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-eea20cb3-c1f3-4885-8660-758d46164c1b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1318 microversion: 2.1 time: 0.150214 May 17 12:10:08.815384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 199/376] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:08 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:08.829627 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-d585adb0-c06a-40e7-954b-4dae99c03d0b req-1a990ecd-8a60-43e9-a6ef-117053d61fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92cb2fa3-d151-4e91-8621-eff4576bd14b", "name": "network-vif-plugged", "status": "completed", "tag": "6ad7b5f7-23e1-4c95-a6e0-f49e836af232"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:08.838896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-d585adb0-c06a-40e7-954b-4dae99c03d0b req-1a990ecd-8a60-43e9-a6ef-117053d61fca service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:08.839347 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-d585adb0-c06a-40e7-954b-4dae99c03d0b req-1a990ecd-8a60-43e9-a6ef-117053d61fca service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:08.851113 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-d585adb0-c06a-40e7-954b-4dae99c03d0b req-1a990ecd-8a60-43e9-a6ef-117053d61fca service nova] Creating event network-vif-plugged:6ad7b5f7-23e1-4c95-a6e0-f49e836af232 for instance 92cb2fa3-d151-4e91-8621-eff4576bd14b on hv-cinder-83769 May 17 12:10:08.856013 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-d585adb0-c06a-40e7-954b-4dae99c03d0b req-1a990ecd-8a60-43e9-a6ef-117053d61fca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030097 May 17 12:10:08.857421 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 178/377] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:10:08.870163 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-67d84462-6260-402f-bb70-2f17257af30b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:08.870776 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-67d84462-6260-402f-bb70-2f17257af30b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:08.876819 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-67d84462-6260-402f-bb70-2f17257af30b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:08.877271 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-67d84462-6260-402f-bb70-2f17257af30b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:08.878050 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-67d84462-6260-402f-bb70-2f17257af30b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:08.878487 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-67d84462-6260-402f-bb70-2f17257af30b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:09.013300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-67d84462-6260-402f-bb70-2f17257af30b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:09.025388 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-67d84462-6260-402f-bb70-2f17257af30b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:09.026945 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-67d84462-6260-402f-bb70-2f17257af30b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:09.029442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-67d84462-6260-402f-bb70-2f17257af30b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.163116 May 17 12:10:09.030348 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 200/378] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:08 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:09.832687 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-28cffa5c-1741-4f83-944d-4311539b323b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:09.833340 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-28cffa5c-1741-4f83-944d-4311539b323b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:09.839944 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28cffa5c-1741-4f83-944d-4311539b323b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:09.840475 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28cffa5c-1741-4f83-944d-4311539b323b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:09.841435 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28cffa5c-1741-4f83-944d-4311539b323b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:09.841877 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28cffa5c-1741-4f83-944d-4311539b323b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:09.967683 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-28cffa5c-1741-4f83-944d-4311539b323b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:09.974957 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-28cffa5c-1741-4f83-944d-4311539b323b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1318 microversion: 2.1 time: 0.146757 May 17 12:10:09.975538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 179/379] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:09 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:10.047787 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-483fbb2a-9601-45aa-a0db-a4bfdc6fba57 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:10.048434 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-483fbb2a-9601-45aa-a0db-a4bfdc6fba57 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:10.054282 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-483fbb2a-9601-45aa-a0db-a4bfdc6fba57 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:10.054733 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-483fbb2a-9601-45aa-a0db-a4bfdc6fba57 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:10.055500 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-483fbb2a-9601-45aa-a0db-a4bfdc6fba57 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:10.055940 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-483fbb2a-9601-45aa-a0db-a4bfdc6fba57 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:10.182597 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-483fbb2a-9601-45aa-a0db-a4bfdc6fba57 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:10.190883 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-483fbb2a-9601-45aa-a0db-a4bfdc6fba57 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:10.192425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-483fbb2a-9601-45aa-a0db-a4bfdc6fba57 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:10.193576 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-483fbb2a-9601-45aa-a0db-a4bfdc6fba57 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.149746 May 17 12:10:10.194138 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 201/380] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:10 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:10.993048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-734c3ef8-cd08-4f38-bd0f-30294c188d75 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:10.993655 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-734c3ef8-cd08-4f38-bd0f-30294c188d75 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:11.000992 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-734c3ef8-cd08-4f38-bd0f-30294c188d75 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:11.001443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-734c3ef8-cd08-4f38-bd0f-30294c188d75 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:11.002204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-734c3ef8-cd08-4f38-bd0f-30294c188d75 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:11.002635 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-734c3ef8-cd08-4f38-bd0f-30294c188d75 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:11.130490 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-734c3ef8-cd08-4f38-bd0f-30294c188d75 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:11.138380 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-734c3ef8-cd08-4f38-bd0f-30294c188d75 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1318 microversion: 2.1 time: 0.149592 May 17 12:10:11.138952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 180/381] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:10 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:11.212288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e1b7481c-c0c1-408c-b225-78565ec642a5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:11.212906 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e1b7481c-c0c1-408c-b225-78565ec642a5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:11.219662 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e1b7481c-c0c1-408c-b225-78565ec642a5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:11.220104 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e1b7481c-c0c1-408c-b225-78565ec642a5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:11.220896 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e1b7481c-c0c1-408c-b225-78565ec642a5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:11.221326 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e1b7481c-c0c1-408c-b225-78565ec642a5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:11.358282 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e1b7481c-c0c1-408c-b225-78565ec642a5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:11.365996 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e1b7481c-c0c1-408c-b225-78565ec642a5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:11.367489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e1b7481c-c0c1-408c-b225-78565ec642a5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:11.368677 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e1b7481c-c0c1-408c-b225-78565ec642a5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.160377 May 17 12:10:11.369214 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 202/382] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:11 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:12.158786 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-969ee82a-00ad-4717-8005-4a4d651b8ba2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:12.159405 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-969ee82a-00ad-4717-8005-4a4d651b8ba2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:12.165779 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-969ee82a-00ad-4717-8005-4a4d651b8ba2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:12.166230 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-969ee82a-00ad-4717-8005-4a4d651b8ba2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:12.167005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-969ee82a-00ad-4717-8005-4a4d651b8ba2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:12.167452 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-969ee82a-00ad-4717-8005-4a4d651b8ba2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:12.294332 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-969ee82a-00ad-4717-8005-4a4d651b8ba2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:12.301682 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-969ee82a-00ad-4717-8005-4a4d651b8ba2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1507 microversion: 2.1 time: 0.146867 May 17 12:10:12.302252 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 181/383] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:12 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:12.318527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0ba68a10-4ad8-4f08-83e2-d35ae936964e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfee680e-f7a8-4557-b330-8ce24ff731bd", "device": "/dev/sdb"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:12.320261 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0ba68a10-4ad8-4f08-83e2-d35ae936964e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:12.326367 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0ba68a10-4ad8-4f08-83e2-d35ae936964e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:12.326808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0ba68a10-4ad8-4f08-83e2-d35ae936964e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:12.327600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0ba68a10-4ad8-4f08-83e2-d35ae936964e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:12.328029 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0ba68a10-4ad8-4f08-83e2-d35ae936964e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:12.386098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5dc8a1ea-3e19-4544-a61e-f93a9fb851b7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:12.386709 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5dc8a1ea-3e19-4544-a61e-f93a9fb851b7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:12.392597 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5dc8a1ea-3e19-4544-a61e-f93a9fb851b7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:12.393104 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5dc8a1ea-3e19-4544-a61e-f93a9fb851b7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:12.393897 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5dc8a1ea-3e19-4544-a61e-f93a9fb851b7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:12.394312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5dc8a1ea-3e19-4544-a61e-f93a9fb851b7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:12.532433 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5dc8a1ea-3e19-4544-a61e-f93a9fb851b7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:12.541128 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5dc8a1ea-3e19-4544-a61e-f93a9fb851b7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:12.542792 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5dc8a1ea-3e19-4544-a61e-f93a9fb851b7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:12.544817 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5dc8a1ea-3e19-4544-a61e-f93a9fb851b7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.162371 May 17 12:10:12.545538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 182/384] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:12 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:10:12.599672 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0ba68a10-4ad8-4f08-83e2-d35ae936964e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "POST /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284862 May 17 12:10:12.600354 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 203/385] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:10:12 2022] POST /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:10:13.563939 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2dd9b1a9-8b4a-4aeb-b14b-093e2dec487b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:13.564593 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2dd9b1a9-8b4a-4aeb-b14b-093e2dec487b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:13.571245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2dd9b1a9-8b4a-4aeb-b14b-093e2dec487b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:13.571697 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2dd9b1a9-8b4a-4aeb-b14b-093e2dec487b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:13.572494 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2dd9b1a9-8b4a-4aeb-b14b-093e2dec487b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:13.572933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2dd9b1a9-8b4a-4aeb-b14b-093e2dec487b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:13.707252 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2dd9b1a9-8b4a-4aeb-b14b-093e2dec487b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:13.715088 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2dd9b1a9-8b4a-4aeb-b14b-093e2dec487b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:13.716694 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2dd9b1a9-8b4a-4aeb-b14b-093e2dec487b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:13.717849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2dd9b1a9-8b4a-4aeb-b14b-093e2dec487b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.158624 May 17 12:10:13.718399 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 183/386] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:13 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:14.736137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b25ea8ff-ffa8-4b4e-9514-a08ed45324ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:14.736853 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b25ea8ff-ffa8-4b4e-9514-a08ed45324ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:14.743659 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b25ea8ff-ffa8-4b4e-9514-a08ed45324ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:14.744115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b25ea8ff-ffa8-4b4e-9514-a08ed45324ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:14.744919 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b25ea8ff-ffa8-4b4e-9514-a08ed45324ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:14.745354 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b25ea8ff-ffa8-4b4e-9514-a08ed45324ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:14.879459 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b25ea8ff-ffa8-4b4e-9514-a08ed45324ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:14.887974 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b25ea8ff-ffa8-4b4e-9514-a08ed45324ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:14.889624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b25ea8ff-ffa8-4b4e-9514-a08ed45324ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:14.890788 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b25ea8ff-ffa8-4b4e-9514-a08ed45324ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.159430 May 17 12:10:14.891349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 204/387] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:14 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:15.909141 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4ba7dd61-4b54-4a07-8789-da1af2a7833e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:15.909749 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4ba7dd61-4b54-4a07-8789-da1af2a7833e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:15.916377 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4ba7dd61-4b54-4a07-8789-da1af2a7833e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:15.916899 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4ba7dd61-4b54-4a07-8789-da1af2a7833e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:15.917659 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4ba7dd61-4b54-4a07-8789-da1af2a7833e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:15.918092 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4ba7dd61-4b54-4a07-8789-da1af2a7833e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:16.043219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4ba7dd61-4b54-4a07-8789-da1af2a7833e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:16.051511 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4ba7dd61-4b54-4a07-8789-da1af2a7833e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:16.052980 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4ba7dd61-4b54-4a07-8789-da1af2a7833e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:16.054126 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4ba7dd61-4b54-4a07-8789-da1af2a7833e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.148818 May 17 12:10:16.054691 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 184/388] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:15 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:17.073028 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fa286f39-54f5-4a73-8572-7a06c47b9fba tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:17.073732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fa286f39-54f5-4a73-8572-7a06c47b9fba tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:17.080636 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa286f39-54f5-4a73-8572-7a06c47b9fba tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:17.081089 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa286f39-54f5-4a73-8572-7a06c47b9fba tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:17.081854 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa286f39-54f5-4a73-8572-7a06c47b9fba tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:17.082287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa286f39-54f5-4a73-8572-7a06c47b9fba tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:17.207192 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fa286f39-54f5-4a73-8572-7a06c47b9fba tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:17.214788 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fa286f39-54f5-4a73-8572-7a06c47b9fba tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:17.216531 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fa286f39-54f5-4a73-8572-7a06c47b9fba tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:17.217667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fa286f39-54f5-4a73-8572-7a06c47b9fba tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.148779 May 17 12:10:17.218223 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 205/389] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:17 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:18.235463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f3771f15-a63c-4209-82ec-a62b7942b971 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:18.236048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f3771f15-a63c-4209-82ec-a62b7942b971 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:18.242308 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f3771f15-a63c-4209-82ec-a62b7942b971 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:18.242758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f3771f15-a63c-4209-82ec-a62b7942b971 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:18.243515 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f3771f15-a63c-4209-82ec-a62b7942b971 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:18.243949 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f3771f15-a63c-4209-82ec-a62b7942b971 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:18.373851 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f3771f15-a63c-4209-82ec-a62b7942b971 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:18.382234 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f3771f15-a63c-4209-82ec-a62b7942b971 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:18.383765 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f3771f15-a63c-4209-82ec-a62b7942b971 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:18.384950 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f3771f15-a63c-4209-82ec-a62b7942b971 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.153472 May 17 12:10:18.385519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 185/390] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:18 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:19.403135 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-11a92e3e-d582-4acf-a819-8168d03158fb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:19.403935 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-11a92e3e-d582-4acf-a819-8168d03158fb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:19.410271 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-11a92e3e-d582-4acf-a819-8168d03158fb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:19.410724 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-11a92e3e-d582-4acf-a819-8168d03158fb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:19.411489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-11a92e3e-d582-4acf-a819-8168d03158fb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:19.411927 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-11a92e3e-d582-4acf-a819-8168d03158fb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:19.543243 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-11a92e3e-d582-4acf-a819-8168d03158fb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:19.551684 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-11a92e3e-d582-4acf-a819-8168d03158fb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:19.553221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-11a92e3e-d582-4acf-a819-8168d03158fb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:19.554514 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-11a92e3e-d582-4acf-a819-8168d03158fb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.155340 May 17 12:10:19.555196 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 206/391] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:19 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:20.573920 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f5735f90-3b38-4532-adaf-b546fca99ddb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:20.574567 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f5735f90-3b38-4532-adaf-b546fca99ddb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:20.582856 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f5735f90-3b38-4532-adaf-b546fca99ddb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:20.583666 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f5735f90-3b38-4532-adaf-b546fca99ddb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:20.585107 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f5735f90-3b38-4532-adaf-b546fca99ddb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:20.585944 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f5735f90-3b38-4532-adaf-b546fca99ddb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:20.713538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f5735f90-3b38-4532-adaf-b546fca99ddb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:20.721400 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f5735f90-3b38-4532-adaf-b546fca99ddb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:20.722829 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f5735f90-3b38-4532-adaf-b546fca99ddb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:20.723992 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f5735f90-3b38-4532-adaf-b546fca99ddb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.154240 May 17 12:10:20.724575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 186/392] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:20 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:21.349044 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c58cc77a-b3b0-45b1-9745-efe2498ba019 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:21.349563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c58cc77a-b3b0-45b1-9745-efe2498ba019 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:21.355711 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c58cc77a-b3b0-45b1-9745-efe2498ba019 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:21.356839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c58cc77a-b3b0-45b1-9745-efe2498ba019 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:21.357672 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c58cc77a-b3b0-45b1-9745-efe2498ba019 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:21.358108 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c58cc77a-b3b0-45b1-9745-efe2498ba019 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:21.379868 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c58cc77a-b3b0-45b1-9745-efe2498ba019 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/ips" status: 200 len: 149 microversion: 2.1 time: 0.034623 May 17 12:10:21.380515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 207/393] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 17 12:10:21 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:10:21.741944 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-39283f6d-9ef0-4055-b3e2-0a14035e1dd5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:21.742557 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-39283f6d-9ef0-4055-b3e2-0a14035e1dd5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:21.749519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-39283f6d-9ef0-4055-b3e2-0a14035e1dd5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:21.749970 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-39283f6d-9ef0-4055-b3e2-0a14035e1dd5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:21.750741 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-39283f6d-9ef0-4055-b3e2-0a14035e1dd5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:21.751183 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-39283f6d-9ef0-4055-b3e2-0a14035e1dd5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:21.887818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-39283f6d-9ef0-4055-b3e2-0a14035e1dd5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:21.895816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-39283f6d-9ef0-4055-b3e2-0a14035e1dd5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:21.897382 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-39283f6d-9ef0-4055-b3e2-0a14035e1dd5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:21.898528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-39283f6d-9ef0-4055-b3e2-0a14035e1dd5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.160470 May 17 12:10:21.899088 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 187/394] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:21 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:22.183407 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3c7b4f02-8489-4a0b-86a3-85e4980fd409 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:22.183998 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3c7b4f02-8489-4a0b-86a3-85e4980fd409 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:22.190189 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c7b4f02-8489-4a0b-86a3-85e4980fd409 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:22.190634 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c7b4f02-8489-4a0b-86a3-85e4980fd409 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:22.191392 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c7b4f02-8489-4a0b-86a3-85e4980fd409 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:22.191823 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c7b4f02-8489-4a0b-86a3-85e4980fd409 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:22.214020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3c7b4f02-8489-4a0b-86a3-85e4980fd409 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/ips" status: 200 len: 143 microversion: 2.1 time: 0.034446 May 17 12:10:22.214587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 208/395] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 17 12:10:22 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/ips => generated 143 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:10:22.917583 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-32f9874b-95fe-41b2-ae05-dc9d2cf8ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:22.918214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-32f9874b-95fe-41b2-ae05-dc9d2cf8ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:22.924639 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-32f9874b-95fe-41b2-ae05-dc9d2cf8ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:22.925095 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-32f9874b-95fe-41b2-ae05-dc9d2cf8ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:22.925866 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-32f9874b-95fe-41b2-ae05-dc9d2cf8ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:22.926304 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-32f9874b-95fe-41b2-ae05-dc9d2cf8ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:23.067985 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-32f9874b-95fe-41b2-ae05-dc9d2cf8ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:23.077850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-32f9874b-95fe-41b2-ae05-dc9d2cf8ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:23.079737 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-32f9874b-95fe-41b2-ae05-dc9d2cf8ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:23.081077 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-32f9874b-95fe-41b2-ae05-dc9d2cf8ddf7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.167792 May 17 12:10:23.081916 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 188/396] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:22 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:24.098715 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-26974784-81b6-4f77-b0f4-ce25f01aec43 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:24.099655 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-26974784-81b6-4f77-b0f4-ce25f01aec43 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:24.105767 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-26974784-81b6-4f77-b0f4-ce25f01aec43 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:24.106229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-26974784-81b6-4f77-b0f4-ce25f01aec43 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:24.107515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-26974784-81b6-4f77-b0f4-ce25f01aec43 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:24.107966 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-26974784-81b6-4f77-b0f4-ce25f01aec43 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:24.232095 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-26974784-81b6-4f77-b0f4-ce25f01aec43 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:24.239706 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-26974784-81b6-4f77-b0f4-ce25f01aec43 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:24.241260 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-26974784-81b6-4f77-b0f4-ce25f01aec43 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:24.242419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-26974784-81b6-4f77-b0f4-ce25f01aec43 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.147698 May 17 12:10:24.242972 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 209/397] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:24 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:25.260845 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-330167e3-558d-4451-b5ca-41405d711450 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:25.261455 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-330167e3-558d-4451-b5ca-41405d711450 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:25.267921 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-330167e3-558d-4451-b5ca-41405d711450 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:25.268405 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-330167e3-558d-4451-b5ca-41405d711450 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:25.269175 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-330167e3-558d-4451-b5ca-41405d711450 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:25.269609 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-330167e3-558d-4451-b5ca-41405d711450 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:25.400620 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-330167e3-558d-4451-b5ca-41405d711450 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:25.409043 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-330167e3-558d-4451-b5ca-41405d711450 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:25.410565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-330167e3-558d-4451-b5ca-41405d711450 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:25.411734 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-330167e3-558d-4451-b5ca-41405d711450 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.154734 May 17 12:10:25.412661 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 189/398] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:25 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:26.430994 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-da7acbf3-20e4-406a-8873-6af9a2520bc2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:26.431609 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-da7acbf3-20e4-406a-8873-6af9a2520bc2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:26.437959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-da7acbf3-20e4-406a-8873-6af9a2520bc2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:26.438411 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-da7acbf3-20e4-406a-8873-6af9a2520bc2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:26.439188 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-da7acbf3-20e4-406a-8873-6af9a2520bc2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:26.440039 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-da7acbf3-20e4-406a-8873-6af9a2520bc2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:26.582181 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-da7acbf3-20e4-406a-8873-6af9a2520bc2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:26.589824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-da7acbf3-20e4-406a-8873-6af9a2520bc2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:26.591324 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-da7acbf3-20e4-406a-8873-6af9a2520bc2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:26.592579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-da7acbf3-20e4-406a-8873-6af9a2520bc2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.166238 May 17 12:10:26.593144 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 210/399] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:26 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:26.905537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-bfbf7056-bfaf-4057-8d63-85e61dd87da8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a2f17e4-eb5f-410a-b325-5b814353e38c"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:26.906659 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-bfbf7056-bfaf-4057-8d63-85e61dd87da8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:26.913304 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bfbf7056-bfaf-4057-8d63-85e61dd87da8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:26.913758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bfbf7056-bfaf-4057-8d63-85e61dd87da8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:26.914529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bfbf7056-bfaf-4057-8d63-85e61dd87da8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:26.914968 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bfbf7056-bfaf-4057-8d63-85e61dd87da8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:27.289785 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-21148e9d-fbdc-41aa-b576-8c5b517cf559 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "278ab210-dd67-4e27-951d-25f0110abfc9"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:27.290934 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-21148e9d-fbdc-41aa-b576-8c5b517cf559 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:27.297466 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-21148e9d-fbdc-41aa-b576-8c5b517cf559 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:27.297948 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-21148e9d-fbdc-41aa-b576-8c5b517cf559 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:27.298756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-21148e9d-fbdc-41aa-b576-8c5b517cf559 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:27.299199 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-21148e9d-fbdc-41aa-b576-8c5b517cf559 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:27.381586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-bfbf7056-bfaf-4057-8d63-85e61dd87da8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.479765 May 17 12:10:27.382197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 190/400] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:10:26 2022] POST /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:10:27.617053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e7f13950-6c2c-48c6-9c1e-1e8a43ab318a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:27.617928 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e7f13950-6c2c-48c6-9c1e-1e8a43ab318a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:27.624353 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e7f13950-6c2c-48c6-9c1e-1e8a43ab318a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:27.624810 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e7f13950-6c2c-48c6-9c1e-1e8a43ab318a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:27.625586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e7f13950-6c2c-48c6-9c1e-1e8a43ab318a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:27.626037 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e7f13950-6c2c-48c6-9c1e-1e8a43ab318a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:27.758789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e7f13950-6c2c-48c6-9c1e-1e8a43ab318a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:27.767067 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e7f13950-6c2c-48c6-9c1e-1e8a43ab318a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:27.768530 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e7f13950-6c2c-48c6-9c1e-1e8a43ab318a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:27.769675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e7f13950-6c2c-48c6-9c1e-1e8a43ab318a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.157445 May 17 12:10:27.770266 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 191/401] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:27 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:10:28.788899 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-dc55a39b-405b-4503-9f8b-f2c99453a312 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:28.789511 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-dc55a39b-405b-4503-9f8b-f2c99453a312 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:28.796585 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dc55a39b-405b-4503-9f8b-f2c99453a312 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:28.797032 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dc55a39b-405b-4503-9f8b-f2c99453a312 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:28.797795 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dc55a39b-405b-4503-9f8b-f2c99453a312 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:28.798234 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dc55a39b-405b-4503-9f8b-f2c99453a312 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:28.923369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-dc55a39b-405b-4503-9f8b-f2c99453a312 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:28.931019 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-dc55a39b-405b-4503-9f8b-f2c99453a312 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:28.932552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-dc55a39b-405b-4503-9f8b-f2c99453a312 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:28.933702 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-dc55a39b-405b-4503-9f8b-f2c99453a312 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.148736 May 17 12:10:28.934761 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 192/402] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:28 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:10:29.953286 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5b28b257-14cf-403d-a9a1-3bdea9728e42 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:29.953890 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5b28b257-14cf-403d-a9a1-3bdea9728e42 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:29.960173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b28b257-14cf-403d-a9a1-3bdea9728e42 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:29.960660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b28b257-14cf-403d-a9a1-3bdea9728e42 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:29.961428 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b28b257-14cf-403d-a9a1-3bdea9728e42 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:29.961863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b28b257-14cf-403d-a9a1-3bdea9728e42 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:30.091556 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5b28b257-14cf-403d-a9a1-3bdea9728e42 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:30.099276 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5b28b257-14cf-403d-a9a1-3bdea9728e42 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:30.100808 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5b28b257-14cf-403d-a9a1-3bdea9728e42 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:30.101985 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5b28b257-14cf-403d-a9a1-3bdea9728e42 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.153275 May 17 12:10:30.102560 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 193/403] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:29 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:10:31.120916 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2afa556a-4f1a-45ab-b44a-5d2bef19736a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:31.121587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2afa556a-4f1a-45ab-b44a-5d2bef19736a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:31.128435 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2afa556a-4f1a-45ab-b44a-5d2bef19736a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:31.128884 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2afa556a-4f1a-45ab-b44a-5d2bef19736a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:31.129649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2afa556a-4f1a-45ab-b44a-5d2bef19736a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:31.130084 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2afa556a-4f1a-45ab-b44a-5d2bef19736a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:31.256940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2afa556a-4f1a-45ab-b44a-5d2bef19736a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:31.265416 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2afa556a-4f1a-45ab-b44a-5d2bef19736a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:31.266909 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2afa556a-4f1a-45ab-b44a-5d2bef19736a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:31.268050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2afa556a-4f1a-45ab-b44a-5d2bef19736a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.151021 May 17 12:10:31.268637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 194/404] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:31 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:10:32.286251 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-92ab4b1a-a03e-49fa-8209-a2ea45efcd7a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:32.286933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-92ab4b1a-a03e-49fa-8209-a2ea45efcd7a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:32.293372 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-92ab4b1a-a03e-49fa-8209-a2ea45efcd7a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:32.294986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-92ab4b1a-a03e-49fa-8209-a2ea45efcd7a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:32.295800 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-92ab4b1a-a03e-49fa-8209-a2ea45efcd7a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:32.296268 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-92ab4b1a-a03e-49fa-8209-a2ea45efcd7a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:32.438556 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-92ab4b1a-a03e-49fa-8209-a2ea45efcd7a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:32.441892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-21148e9d-fbdc-41aa-b576-8c5b517cf559 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.155951 May 17 12:10:32.442917 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 211/405] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:10:27 2022] POST /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/os-volume_attachments => generated 194 bytes in 5158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:10:32.446778 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-92ab4b1a-a03e-49fa-8209-a2ea45efcd7a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:32.449549 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-92ab4b1a-a03e-49fa-8209-a2ea45efcd7a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:32.451196 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-92ab4b1a-a03e-49fa-8209-a2ea45efcd7a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.168815 May 17 12:10:32.454456 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 195/406] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:32 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:10:33.472067 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2017bd50-cd9d-4005-9568-04721e56c3f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:33.472788 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2017bd50-cd9d-4005-9568-04721e56c3f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:33.480156 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2017bd50-cd9d-4005-9568-04721e56c3f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:33.480820 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2017bd50-cd9d-4005-9568-04721e56c3f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:33.482465 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2017bd50-cd9d-4005-9568-04721e56c3f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:33.482903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2017bd50-cd9d-4005-9568-04721e56c3f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:33.618469 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2017bd50-cd9d-4005-9568-04721e56c3f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:33.627077 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2017bd50-cd9d-4005-9568-04721e56c3f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:33.628885 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2017bd50-cd9d-4005-9568-04721e56c3f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:33.630033 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2017bd50-cd9d-4005-9568-04721e56c3f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.162232 May 17 12:10:33.630690 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 212/407] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:33 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:34.431655 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-347b00cf-96dd-4ce1-9507-9c1dce3417af req-058938f1-63b7-4485-885e-682d81943157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d883f923-082e-4ee1-ba3e-0975ba2d7409", "name": "network-vif-plugged", "status": "completed", "tag": "cf6ad775-daff-4e4a-b3ee-b4652d53fdfe"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:34.441446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-347b00cf-96dd-4ce1-9507-9c1dce3417af req-058938f1-63b7-4485-885e-682d81943157 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:34.441898 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-347b00cf-96dd-4ce1-9507-9c1dce3417af req-058938f1-63b7-4485-885e-682d81943157 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:34.453945 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-347b00cf-96dd-4ce1-9507-9c1dce3417af req-058938f1-63b7-4485-885e-682d81943157 service nova] Creating event network-vif-plugged:cf6ad775-daff-4e4a-b3ee-b4652d53fdfe for instance d883f923-082e-4ee1-ba3e-0975ba2d7409 on hv-cinder-83769 May 17 12:10:34.458867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-347b00cf-96dd-4ce1-9507-9c1dce3417af req-058938f1-63b7-4485-885e-682d81943157 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031150 May 17 12:10:34.459628 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 196/408] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:10:34.649293 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1966e4a8-0867-4257-be21-8b900ab515c8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:34.649900 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1966e4a8-0867-4257-be21-8b900ab515c8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:34.656405 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1966e4a8-0867-4257-be21-8b900ab515c8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:34.656849 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1966e4a8-0867-4257-be21-8b900ab515c8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:34.657613 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1966e4a8-0867-4257-be21-8b900ab515c8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:34.658045 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1966e4a8-0867-4257-be21-8b900ab515c8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:34.782706 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1966e4a8-0867-4257-be21-8b900ab515c8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:34.790374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1966e4a8-0867-4257-be21-8b900ab515c8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:34.791862 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1966e4a8-0867-4257-be21-8b900ab515c8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:34.793031 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1966e4a8-0867-4257-be21-8b900ab515c8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.147609 May 17 12:10:34.794161 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 213/409] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:34 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:35.812471 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ea6007b6-c148-418c-91fc-40dc6ffea777 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:35.813089 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ea6007b6-c148-418c-91fc-40dc6ffea777 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:35.819211 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ea6007b6-c148-418c-91fc-40dc6ffea777 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:35.819665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ea6007b6-c148-418c-91fc-40dc6ffea777 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:35.820457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ea6007b6-c148-418c-91fc-40dc6ffea777 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:35.820898 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ea6007b6-c148-418c-91fc-40dc6ffea777 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:35.948993 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ea6007b6-c148-418c-91fc-40dc6ffea777 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:35.957621 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ea6007b6-c148-418c-91fc-40dc6ffea777 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:35.959405 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ea6007b6-c148-418c-91fc-40dc6ffea777 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:35.960674 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ea6007b6-c148-418c-91fc-40dc6ffea777 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.153594 May 17 12:10:35.961317 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 197/410] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:35 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:36.978618 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-95698c2f-dfe7-4532-b72b-0af7414f2c24 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:36.979223 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-95698c2f-dfe7-4532-b72b-0af7414f2c24 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:36.985602 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95698c2f-dfe7-4532-b72b-0af7414f2c24 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:36.986049 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95698c2f-dfe7-4532-b72b-0af7414f2c24 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:36.986805 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95698c2f-dfe7-4532-b72b-0af7414f2c24 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:36.987244 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95698c2f-dfe7-4532-b72b-0af7414f2c24 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:37.045614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-06b81634-1258-4202-b3d7-ea01206ffcd6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:37.046130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-06b81634-1258-4202-b3d7-ea01206ffcd6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:37.052493 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-06b81634-1258-4202-b3d7-ea01206ffcd6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:37.052937 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-06b81634-1258-4202-b3d7-ea01206ffcd6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:37.053711 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-06b81634-1258-4202-b3d7-ea01206ffcd6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:37.054144 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-06b81634-1258-4202-b3d7-ea01206ffcd6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:37.133716 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-06b81634-1258-4202-b3d7-ea01206ffcd6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lazy-loading 'services' on Instance uuid 92cb2fa3-d151-4e91-8621-eff4576bd14b {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:10:37.135382 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-95698c2f-dfe7-4532-b72b-0af7414f2c24 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:37.143783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-95698c2f-dfe7-4532-b72b-0af7414f2c24 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:37.145311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-95698c2f-dfe7-4532-b72b-0af7414f2c24 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:37.146460 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-95698c2f-dfe7-4532-b72b-0af7414f2c24 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.171751 May 17 12:10:37.147015 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 214/411] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:36 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:37.204603 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-06b81634-1258-4202-b3d7-ea01206ffcd6 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "DELETE /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b/os-volume_attachments/cfee680e-f7a8-4557-b330-8ce24ff731bd" status: 202 len: 0 microversion: 2.1 time: 0.162718 May 17 12:10:37.205228 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 198/412] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:10:37 2022] DELETE /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b/os-volume_attachments/cfee680e-f7a8-4557-b330-8ce24ff731bd => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 12:10:38.163903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-22deb598-8990-4de8-b55e-5f177acaac01 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:38.164561 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-22deb598-8990-4de8-b55e-5f177acaac01 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:38.171485 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-22deb598-8990-4de8-b55e-5f177acaac01 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:38.171928 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-22deb598-8990-4de8-b55e-5f177acaac01 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:38.172720 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-22deb598-8990-4de8-b55e-5f177acaac01 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:38.173150 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-22deb598-8990-4de8-b55e-5f177acaac01 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:38.298728 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-22deb598-8990-4de8-b55e-5f177acaac01 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:38.306753 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-22deb598-8990-4de8-b55e-5f177acaac01 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:38.308394 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-22deb598-8990-4de8-b55e-5f177acaac01 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:38.309658 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-22deb598-8990-4de8-b55e-5f177acaac01 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.149582 May 17 12:10:38.310290 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 215/413] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:38 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:39.328574 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6b1d8fe7-1ce1-4676-abf7-3eb78464a67b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:39.329269 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6b1d8fe7-1ce1-4676-abf7-3eb78464a67b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:39.335486 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6b1d8fe7-1ce1-4676-abf7-3eb78464a67b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:39.335934 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6b1d8fe7-1ce1-4676-abf7-3eb78464a67b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:39.336746 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6b1d8fe7-1ce1-4676-abf7-3eb78464a67b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:39.337175 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6b1d8fe7-1ce1-4676-abf7-3eb78464a67b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:39.463489 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6b1d8fe7-1ce1-4676-abf7-3eb78464a67b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:39.471601 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6b1d8fe7-1ce1-4676-abf7-3eb78464a67b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:39.473114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6b1d8fe7-1ce1-4676-abf7-3eb78464a67b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:39.474259 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6b1d8fe7-1ce1-4676-abf7-3eb78464a67b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.150464 May 17 12:10:39.474824 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 199/414] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:39 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:40.492224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4e1c53b4-b757-4c7a-adf3-2bc3e958a81e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:40.492843 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4e1c53b4-b757-4c7a-adf3-2bc3e958a81e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:40.499875 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4e1c53b4-b757-4c7a-adf3-2bc3e958a81e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:40.500359 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4e1c53b4-b757-4c7a-adf3-2bc3e958a81e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:40.501128 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4e1c53b4-b757-4c7a-adf3-2bc3e958a81e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:40.501569 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4e1c53b4-b757-4c7a-adf3-2bc3e958a81e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:40.640173 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4e1c53b4-b757-4c7a-adf3-2bc3e958a81e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:40.648773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4e1c53b4-b757-4c7a-adf3-2bc3e958a81e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:40.650292 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4e1c53b4-b757-4c7a-adf3-2bc3e958a81e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:40.651583 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4e1c53b4-b757-4c7a-adf3-2bc3e958a81e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1744 microversion: 2.20 time: 0.163279 May 17 12:10:40.652465 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 216/415] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:40 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:41.671010 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-263d2f21-138e-46f1-ac5a-0fd94d0078f2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:41.671540 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-263d2f21-138e-46f1-ac5a-0fd94d0078f2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:41.677834 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-263d2f21-138e-46f1-ac5a-0fd94d0078f2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:41.678302 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-263d2f21-138e-46f1-ac5a-0fd94d0078f2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:41.679073 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-263d2f21-138e-46f1-ac5a-0fd94d0078f2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:41.679757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-263d2f21-138e-46f1-ac5a-0fd94d0078f2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:41.826748 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-263d2f21-138e-46f1-ac5a-0fd94d0078f2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:41.834862 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-263d2f21-138e-46f1-ac5a-0fd94d0078f2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:41.836831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-263d2f21-138e-46f1-ac5a-0fd94d0078f2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:41.838021 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-263d2f21-138e-46f1-ac5a-0fd94d0078f2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.171718 May 17 12:10:41.838758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 200/416] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:41 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:42.290267 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9a5d3efc-959f-4b32-b569-f140115ea1dd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: .version_select at 0x7f2db43ed5e0>, body: {"keypair": {"name": "tempest-keypair-1192214969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1D0pWblgaKSKEwQBNWIscd0jqAmAjAG5Lew7/jjktfxQMKRfxA7pNus+w9m0cihorRYSIRRdpEDUEEDGZPyK1TW/zpHIw1FT4JxwTo9s/9Rv59CQLt45V701ihxyDYmQ=="}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:42.305288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-9a5d3efc-959f-4b32-b569-f140115ea1dd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for project 27acd98621cd4a51ac46fb12e1824168. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:10:42.309401 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-9a5d3efc-959f-4b32-b569-f140115ea1dd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for user 586e15d5d16543e6b70c87fbf9079e9e and project 27acd98621cd4a51ac46fb12e1824168. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:10:42.334059 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9a5d3efc-959f-4b32-b569-f140115ea1dd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047528 May 17 12:10:42.341063 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 217/417] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 17 12:10:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:10:42.859630 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-debefe2c-7ee6-4820-ae5a-36edf57b6d3f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:42.860346 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-debefe2c-7ee6-4820-ae5a-36edf57b6d3f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:42.867568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-debefe2c-7ee6-4820-ae5a-36edf57b6d3f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:42.868094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-debefe2c-7ee6-4820-ae5a-36edf57b6d3f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:42.868985 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-debefe2c-7ee6-4820-ae5a-36edf57b6d3f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:42.869631 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-debefe2c-7ee6-4820-ae5a-36edf57b6d3f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:43.046321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-debefe2c-7ee6-4820-ae5a-36edf57b6d3f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:43.054189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-debefe2c-7ee6-4820-ae5a-36edf57b6d3f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:43.055680 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-debefe2c-7ee6-4820-ae5a-36edf57b6d3f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:43.056870 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-debefe2c-7ee6-4820-ae5a-36edf57b6d3f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.202318 May 17 12:10:43.057626 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 201/418] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:42 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:43.983068 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-880650589", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ff54b2b-d245-42b7-9e38-b4510eee82b9"}], "security_groups": [{"name": "tempest-securitygroup--637774313"}], "key_name": "tempest-keypair-1192214969", "user_data": "}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:44.077619 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f1843e85-0c68-4253-807a-fbc61c618828 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:44.078327 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f1843e85-0c68-4253-807a-fbc61c618828 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:44.085168 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f1843e85-0c68-4253-807a-fbc61c618828 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:44.085693 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f1843e85-0c68-4253-807a-fbc61c618828 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:44.087181 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f1843e85-0c68-4253-807a-fbc61c618828 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:44.087794 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f1843e85-0c68-4253-807a-fbc61c618828 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:44.088047 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.network.neutron [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] validate_networks() for [('9ff54b2b-d245-42b7-9e38-b4510eee82b9', None, None, None, None, None)] {{(pid=117114) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:10:44.235275 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f1843e85-0c68-4253-807a-fbc61c618828 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:44.244029 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f1843e85-0c68-4253-807a-fbc61c618828 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:44.245578 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f1843e85-0c68-4253-807a-fbc61c618828 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:44.246847 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f1843e85-0c68-4253-807a-fbc61c618828 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.175426 May 17 12:10:44.257840 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 202/419] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:44 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:44.476764 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Flavor limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:10:44.477195 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Image limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:10:44.477665 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Flavor pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:10:44.478390 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Image pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:10:44.480694 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:10:44.491707 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:44.492160 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:44.493195 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:44.493644 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:44.515175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for project 27acd98621cd4a51ac46fb12e1824168. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:10:44.519468 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for user 586e15d5d16543e6b70c87fbf9079e9e and project 27acd98621cd4a51ac46fb12e1824168. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:10:44.541640 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Going to run 1 instances... {{(pid=117114) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:10:44.543998 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:10:44.598052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-714f3b08-0603-4467-bc2d-54a253a52867 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.619769 May 17 12:10:44.607449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 218/420] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:10:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:10:44.613888 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6f1c3b73-87ee-4527-a173-ccecf30daab9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:44.614529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6f1c3b73-87ee-4527-a173-ccecf30daab9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:44.677294 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6f1c3b73-87ee-4527-a173-ccecf30daab9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:44.689383 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6f1c3b73-87ee-4527-a173-ccecf30daab9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1241 microversion: 2.1 time: 0.079575 May 17 12:10:44.689715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 203/421] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:44 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:45.266880 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0876c21e-e01f-4627-8a28-4f4c28a6902a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:45.267436 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0876c21e-e01f-4627-8a28-4f4c28a6902a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:45.282938 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0876c21e-e01f-4627-8a28-4f4c28a6902a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:45.283389 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0876c21e-e01f-4627-8a28-4f4c28a6902a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:45.284167 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0876c21e-e01f-4627-8a28-4f4c28a6902a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:45.284806 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0876c21e-e01f-4627-8a28-4f4c28a6902a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:45.439589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0876c21e-e01f-4627-8a28-4f4c28a6902a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:45.453711 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0876c21e-e01f-4627-8a28-4f4c28a6902a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:45.455558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0876c21e-e01f-4627-8a28-4f4c28a6902a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:45.457238 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0876c21e-e01f-4627-8a28-4f4c28a6902a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.195504 May 17 12:10:45.458601 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 219/422] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:45 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:45.707264 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fe6003f6-fc2b-4ed8-8208-2ffffd18ae3e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:45.708931 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fe6003f6-fc2b-4ed8-8208-2ffffd18ae3e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:45.716279 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fe6003f6-fc2b-4ed8-8208-2ffffd18ae3e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:45.717218 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fe6003f6-fc2b-4ed8-8208-2ffffd18ae3e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:45.718385 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fe6003f6-fc2b-4ed8-8208-2ffffd18ae3e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:45.719789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fe6003f6-fc2b-4ed8-8208-2ffffd18ae3e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:45.801547 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-fe6003f6-fc2b-4ed8-8208-2ffffd18ae3e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:45.809284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fe6003f6-fc2b-4ed8-8208-2ffffd18ae3e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1293 microversion: 2.1 time: 0.106096 May 17 12:10:45.814111 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 204/423] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:45 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:46.478866 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e891b520-e13f-4c2f-bfed-841ea47087df tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:46.481635 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e891b520-e13f-4c2f-bfed-841ea47087df tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:46.498071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e891b520-e13f-4c2f-bfed-841ea47087df tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:46.498823 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e891b520-e13f-4c2f-bfed-841ea47087df tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:46.499916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e891b520-e13f-4c2f-bfed-841ea47087df tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:46.500922 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e891b520-e13f-4c2f-bfed-841ea47087df tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:46.669384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e891b520-e13f-4c2f-bfed-841ea47087df tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:46.678279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e891b520-e13f-4c2f-bfed-841ea47087df tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:46.680041 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e891b520-e13f-4c2f-bfed-841ea47087df tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:46.681704 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e891b520-e13f-4c2f-bfed-841ea47087df tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.208394 May 17 12:10:46.694484 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 220/424] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:46 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:46.840116 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c360bc25-2750-4dfb-b8cf-91b16b115f7b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:46.844875 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c360bc25-2750-4dfb-b8cf-91b16b115f7b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:46.863471 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c360bc25-2750-4dfb-b8cf-91b16b115f7b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:46.866269 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c360bc25-2750-4dfb-b8cf-91b16b115f7b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:46.867446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c360bc25-2750-4dfb-b8cf-91b16b115f7b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:46.869027 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c360bc25-2750-4dfb-b8cf-91b16b115f7b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:47.119765 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c360bc25-2750-4dfb-b8cf-91b16b115f7b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:47.129013 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c360bc25-2750-4dfb-b8cf-91b16b115f7b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.300072 May 17 12:10:47.130379 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 205/425] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:46 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:47.702148 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-144f13ee-8847-40a4-a058-ebb2753ce4a6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:47.703442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-144f13ee-8847-40a4-a058-ebb2753ce4a6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:47.710599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-144f13ee-8847-40a4-a058-ebb2753ce4a6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:47.717639 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-144f13ee-8847-40a4-a058-ebb2753ce4a6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:47.718718 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-144f13ee-8847-40a4-a058-ebb2753ce4a6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:47.719317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-144f13ee-8847-40a4-a058-ebb2753ce4a6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:47.831576 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-88b6800e-d58a-44a6-a1e1-150c3e7b5d53 req-e3e5a330-b566-4038-9d7c-bf280bbe3ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3692e0a7-74c5-43c9-8047-bc13959c2db7", "tag": "7506035a-9a00-4a41-add4-17fb7a9190e6"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:47.850984 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-88b6800e-d58a-44a6-a1e1-150c3e7b5d53 req-e3e5a330-b566-4038-9d7c-bf280bbe3ac7 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:47.852750 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-88b6800e-d58a-44a6-a1e1-150c3e7b5d53 req-e3e5a330-b566-4038-9d7c-bf280bbe3ac7 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:47.892842 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-88b6800e-d58a-44a6-a1e1-150c3e7b5d53 req-e3e5a330-b566-4038-9d7c-bf280bbe3ac7 service nova] Creating event network-changed:7506035a-9a00-4a41-add4-17fb7a9190e6 for instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 on hv-cinder-83769 May 17 12:10:47.900217 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-88b6800e-d58a-44a6-a1e1-150c3e7b5d53 req-e3e5a330-b566-4038-9d7c-bf280bbe3ac7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072178 May 17 12:10:47.901449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 206/426] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:10:47.938279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-144f13ee-8847-40a4-a058-ebb2753ce4a6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:47.948081 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-144f13ee-8847-40a4-a058-ebb2753ce4a6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:47.949260 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-144f13ee-8847-40a4-a058-ebb2753ce4a6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:47.957951 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-144f13ee-8847-40a4-a058-ebb2753ce4a6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.260019 May 17 12:10:47.959563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 221/427] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:47 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:48.149458 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-779ea98d-bcac-4406-9110-8dde850ed66e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:48.150195 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-779ea98d-bcac-4406-9110-8dde850ed66e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:48.158542 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-779ea98d-bcac-4406-9110-8dde850ed66e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:48.159247 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-779ea98d-bcac-4406-9110-8dde850ed66e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:48.160082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-779ea98d-bcac-4406-9110-8dde850ed66e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:48.160960 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-779ea98d-bcac-4406-9110-8dde850ed66e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:48.311232 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-779ea98d-bcac-4406-9110-8dde850ed66e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:48.321615 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-779ea98d-bcac-4406-9110-8dde850ed66e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.177355 May 17 12:10:48.336121 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 207/428] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:48 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:48.977887 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-be7b2472-7225-4ae7-96f9-02fe879b39e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:48.978695 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-be7b2472-7225-4ae7-96f9-02fe879b39e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:48.985476 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-be7b2472-7225-4ae7-96f9-02fe879b39e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:48.985995 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-be7b2472-7225-4ae7-96f9-02fe879b39e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:48.986850 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-be7b2472-7225-4ae7-96f9-02fe879b39e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:48.987379 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-be7b2472-7225-4ae7-96f9-02fe879b39e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:49.128991 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-be7b2472-7225-4ae7-96f9-02fe879b39e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:49.136935 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-be7b2472-7225-4ae7-96f9-02fe879b39e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:49.139152 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-be7b2472-7225-4ae7-96f9-02fe879b39e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:49.140352 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-be7b2472-7225-4ae7-96f9-02fe879b39e5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.166819 May 17 12:10:49.140920 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 222/429] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:48 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:49.342648 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-93911c32-6118-4b0d-94c8-6a96c4fb31da tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:49.344117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-93911c32-6118-4b0d-94c8-6a96c4fb31da tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:49.355507 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93911c32-6118-4b0d-94c8-6a96c4fb31da tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:49.355955 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93911c32-6118-4b0d-94c8-6a96c4fb31da tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:49.357014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93911c32-6118-4b0d-94c8-6a96c4fb31da tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:49.358604 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-93911c32-6118-4b0d-94c8-6a96c4fb31da tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:49.509215 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9ad79b5c-622f-4523-a0c7-353a1f6661a7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:49.521591 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9ad79b5c-622f-4523-a0c7-353a1f6661a7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:49.525192 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9ad79b5c-622f-4523-a0c7-353a1f6661a7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:49.610683 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9ad79b5c-622f-4523-a0c7-353a1f6661a7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Going to try to stop instance {{(pid=117114) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 12:10:49.652884 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-93911c32-6118-4b0d-94c8-6a96c4fb31da tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:49.665390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-93911c32-6118-4b0d-94c8-6a96c4fb31da tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.329176 May 17 12:10:49.670757 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9ad79b5c-622f-4523-a0c7-353a1f6661a7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/action" status: 202 len: 0 microversion: 2.1 time: 0.166090 May 17 12:10:49.674350 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 223/430] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:10:49 2022] POST /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:10:49.679979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 208/431] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:49 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:49.680397 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0abc804b-d469-4b63-a9f2-85b3afd58cfc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:49.681202 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0abc804b-d469-4b63-a9f2-85b3afd58cfc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:49.688298 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0abc804b-d469-4b63-a9f2-85b3afd58cfc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:49.688884 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0abc804b-d469-4b63-a9f2-85b3afd58cfc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:49.690288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0abc804b-d469-4b63-a9f2-85b3afd58cfc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:49.690288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0abc804b-d469-4b63-a9f2-85b3afd58cfc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:49.839538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0abc804b-d469-4b63-a9f2-85b3afd58cfc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:49.850441 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0abc804b-d469-4b63-a9f2-85b3afd58cfc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.174348 May 17 12:10:49.851428 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 224/432] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:49 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:50.135792 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1982dbc2-f0b5-45a2-b32a-bd2daace0d6e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:50.136593 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1982dbc2-f0b5-45a2-b32a-bd2daace0d6e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:50.143765 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1982dbc2-f0b5-45a2-b32a-bd2daace0d6e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:50.144344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1982dbc2-f0b5-45a2-b32a-bd2daace0d6e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:50.145219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1982dbc2-f0b5-45a2-b32a-bd2daace0d6e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:50.145724 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1982dbc2-f0b5-45a2-b32a-bd2daace0d6e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:50.161456 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8fcb0074-24bd-4764-9594-94dbf6228dee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:50.164209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8fcb0074-24bd-4764-9594-94dbf6228dee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:50.172458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8fcb0074-24bd-4764-9594-94dbf6228dee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:50.173214 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8fcb0074-24bd-4764-9594-94dbf6228dee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:50.174554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8fcb0074-24bd-4764-9594-94dbf6228dee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:50.175199 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8fcb0074-24bd-4764-9594-94dbf6228dee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:50.175310 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1982dbc2-f0b5-45a2-b32a-bd2daace0d6e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Going to try to terminate instance {{(pid=117113) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:10:50.291488 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1982dbc2-f0b5-45a2-b32a-bd2daace0d6e tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "DELETE /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 204 len: 0 microversion: 2.1 time: 0.159461 May 17 12:10:50.297269 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 209/433] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:10:50 2022] DELETE /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:10:50.303347 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3e883b84-3a2d-4666-9b0c-782af5fe7b72 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:50.304130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-3e883b84-3a2d-4666-9b0c-782af5fe7b72 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:50.311594 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3e883b84-3a2d-4666-9b0c-782af5fe7b72 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:50.312311 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3e883b84-3a2d-4666-9b0c-782af5fe7b72 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:50.313194 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3e883b84-3a2d-4666-9b0c-782af5fe7b72 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:50.313610 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3e883b84-3a2d-4666-9b0c-782af5fe7b72 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:50.347885 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8fcb0074-24bd-4764-9594-94dbf6228dee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:50.355976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8fcb0074-24bd-4764-9594-94dbf6228dee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:50.358259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8fcb0074-24bd-4764-9594-94dbf6228dee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:50.359429 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8fcb0074-24bd-4764-9594-94dbf6228dee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.204877 May 17 12:10:50.364223 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 225/434] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:50 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:10:50.463868 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3e883b84-3a2d-4666-9b0c-782af5fe7b72 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:50.473361 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-3e883b84-3a2d-4666-9b0c-782af5fe7b72 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1559 microversion: 2.1 time: 0.174875 May 17 12:10:50.484434 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 210/435] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:50 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:50.682573 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f0008183-4b31-4037-830a-34f21ad495fd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:50.683422 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f0008183-4b31-4037-830a-34f21ad495fd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:50.690317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f0008183-4b31-4037-830a-34f21ad495fd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:50.693122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f0008183-4b31-4037-830a-34f21ad495fd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:50.694053 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f0008183-4b31-4037-830a-34f21ad495fd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:50.694561 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f0008183-4b31-4037-830a-34f21ad495fd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:50.835544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f0008183-4b31-4037-830a-34f21ad495fd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:50.844566 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f0008183-4b31-4037-830a-34f21ad495fd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.165847 May 17 12:10:50.854655 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 226/436] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:50 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:50.874606 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-871adc00-4946-4bf4-9a48-4b0efa3d2080 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:50.875235 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-871adc00-4946-4bf4-9a48-4b0efa3d2080 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:50.881488 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-871adc00-4946-4bf4-9a48-4b0efa3d2080 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:50.881909 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-871adc00-4946-4bf4-9a48-4b0efa3d2080 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:50.882722 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-871adc00-4946-4bf4-9a48-4b0efa3d2080 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:50.883179 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-871adc00-4946-4bf4-9a48-4b0efa3d2080 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:51.027483 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-871adc00-4946-4bf4-9a48-4b0efa3d2080 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:51.036371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-871adc00-4946-4bf4-9a48-4b0efa3d2080 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.167898 May 17 12:10:51.036958 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 211/437] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:50 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:51.378307 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b421e740-60d7-4daa-853c-ce328a8a2b4f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:51.378860 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b421e740-60d7-4daa-853c-ce328a8a2b4f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:51.385337 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b421e740-60d7-4daa-853c-ce328a8a2b4f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:51.385789 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b421e740-60d7-4daa-853c-ce328a8a2b4f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:51.386793 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b421e740-60d7-4daa-853c-ce328a8a2b4f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:51.386989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b421e740-60d7-4daa-853c-ce328a8a2b4f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:51.491279 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a746f3bc-fd7d-4351-a58a-2269a8076659 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:51.492418 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a746f3bc-fd7d-4351-a58a-2269a8076659 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:51.503023 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a746f3bc-fd7d-4351-a58a-2269a8076659 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:51.503640 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a746f3bc-fd7d-4351-a58a-2269a8076659 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:51.505251 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a746f3bc-fd7d-4351-a58a-2269a8076659 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:51.505251 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a746f3bc-fd7d-4351-a58a-2269a8076659 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:51.565402 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b421e740-60d7-4daa-853c-ce328a8a2b4f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:51.574360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b421e740-60d7-4daa-853c-ce328a8a2b4f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:51.576531 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b421e740-60d7-4daa-853c-ce328a8a2b4f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:51.577730 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b421e740-60d7-4daa-853c-ce328a8a2b4f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.203590 May 17 12:10:51.578514 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 227/438] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:51 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:51.688430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a746f3bc-fd7d-4351-a58a-2269a8076659 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:51.696126 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a746f3bc-fd7d-4351-a58a-2269a8076659 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1559 microversion: 2.1 time: 0.209007 May 17 12:10:51.697122 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 212/439] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:51 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:51.861551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-db764122-ed0a-4053-a933-bb07b33cd268 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:51.862694 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-db764122-ed0a-4053-a933-bb07b33cd268 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:51.869406 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-db764122-ed0a-4053-a933-bb07b33cd268 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:51.870136 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-db764122-ed0a-4053-a933-bb07b33cd268 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:51.871129 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-db764122-ed0a-4053-a933-bb07b33cd268 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:51.872003 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-db764122-ed0a-4053-a933-bb07b33cd268 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:52.037657 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-db764122-ed0a-4053-a933-bb07b33cd268 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:52.048872 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-db764122-ed0a-4053-a933-bb07b33cd268 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.189258 May 17 12:10:52.059774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ab64214c-5e4b-4cfe-bdcb-de7b3e720b95 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:52.059774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ab64214c-5e4b-4cfe-bdcb-de7b3e720b95 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:52.061283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 228/440] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:51 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:52.062265 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab64214c-5e4b-4cfe-bdcb-de7b3e720b95 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:52.062719 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab64214c-5e4b-4cfe-bdcb-de7b3e720b95 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:52.063499 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab64214c-5e4b-4cfe-bdcb-de7b3e720b95 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:52.063932 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab64214c-5e4b-4cfe-bdcb-de7b3e720b95 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:52.203731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ab64214c-5e4b-4cfe-bdcb-de7b3e720b95 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:52.211698 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ab64214c-5e4b-4cfe-bdcb-de7b3e720b95 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.161486 May 17 12:10:52.221838 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 213/441] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:52 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:52.595715 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-38aba2cb-c5a4-46b9-b860-d55baab54659 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:52.596361 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-38aba2cb-c5a4-46b9-b860-d55baab54659 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:52.602696 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38aba2cb-c5a4-46b9-b860-d55baab54659 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:52.603152 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38aba2cb-c5a4-46b9-b860-d55baab54659 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:52.603919 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38aba2cb-c5a4-46b9-b860-d55baab54659 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:52.604391 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38aba2cb-c5a4-46b9-b860-d55baab54659 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:52.714026 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7af40fa4-86dc-4015-9edc-946604e1dd68 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:52.714665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7af40fa4-86dc-4015-9edc-946604e1dd68 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:52.722312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7af40fa4-86dc-4015-9edc-946604e1dd68 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:52.722809 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7af40fa4-86dc-4015-9edc-946604e1dd68 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:52.723706 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7af40fa4-86dc-4015-9edc-946604e1dd68 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:52.724150 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7af40fa4-86dc-4015-9edc-946604e1dd68 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:52.735465 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-38aba2cb-c5a4-46b9-b860-d55baab54659 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:52.743089 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-38aba2cb-c5a4-46b9-b860-d55baab54659 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:52.744600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-38aba2cb-c5a4-46b9-b860-d55baab54659 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:52.745748 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-38aba2cb-c5a4-46b9-b860-d55baab54659 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.154855 May 17 12:10:52.746310 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 229/442] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:52 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:52.855680 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7af40fa4-86dc-4015-9edc-946604e1dd68 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:52.863766 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7af40fa4-86dc-4015-9edc-946604e1dd68 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1559 microversion: 2.1 time: 0.153746 May 17 12:10:52.864360 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 214/443] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:52 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:53.067216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cddc25c7-a48f-4967-b348-9fc39b1c4d91 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:53.067829 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cddc25c7-a48f-4967-b348-9fc39b1c4d91 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:53.074205 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cddc25c7-a48f-4967-b348-9fc39b1c4d91 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:53.074658 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cddc25c7-a48f-4967-b348-9fc39b1c4d91 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:53.076104 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cddc25c7-a48f-4967-b348-9fc39b1c4d91 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:53.076572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cddc25c7-a48f-4967-b348-9fc39b1c4d91 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:53.206201 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cddc25c7-a48f-4967-b348-9fc39b1c4d91 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:53.213542 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cddc25c7-a48f-4967-b348-9fc39b1c4d91 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.150409 May 17 12:10:53.214115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 230/444] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:53 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:53.228337 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1f5b3b72-98cd-4107-81df-492d35efe1c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:53.228948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1f5b3b72-98cd-4107-81df-492d35efe1c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:53.235437 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f5b3b72-98cd-4107-81df-492d35efe1c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:53.235882 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f5b3b72-98cd-4107-81df-492d35efe1c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:53.236669 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f5b3b72-98cd-4107-81df-492d35efe1c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:53.237103 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f5b3b72-98cd-4107-81df-492d35efe1c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:53.360514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1f5b3b72-98cd-4107-81df-492d35efe1c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:53.368174 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1f5b3b72-98cd-4107-81df-492d35efe1c1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.143669 May 17 12:10:53.368762 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 215/445] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:53 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:53.764336 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-63feb25e-ffd1-415b-88e0-3f266fcd3f98 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:53.764962 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-63feb25e-ffd1-415b-88e0-3f266fcd3f98 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:53.771232 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63feb25e-ffd1-415b-88e0-3f266fcd3f98 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:53.771687 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63feb25e-ffd1-415b-88e0-3f266fcd3f98 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:53.772475 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63feb25e-ffd1-415b-88e0-3f266fcd3f98 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:53.772912 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63feb25e-ffd1-415b-88e0-3f266fcd3f98 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:53.881492 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-537d8e82-1e63-4f2e-ac0b-d4a0575276af tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:53.882107 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-537d8e82-1e63-4f2e-ac0b-d4a0575276af tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:53.889088 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-537d8e82-1e63-4f2e-ac0b-d4a0575276af tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:53.889541 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-537d8e82-1e63-4f2e-ac0b-d4a0575276af tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:53.890322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-537d8e82-1e63-4f2e-ac0b-d4a0575276af tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:53.890764 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-537d8e82-1e63-4f2e-ac0b-d4a0575276af tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:53.897541 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-63feb25e-ffd1-415b-88e0-3f266fcd3f98 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:53.905808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-63feb25e-ffd1-415b-88e0-3f266fcd3f98 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:53.907320 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-63feb25e-ffd1-415b-88e0-3f266fcd3f98 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:53.908501 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-63feb25e-ffd1-415b-88e0-3f266fcd3f98 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.148448 May 17 12:10:53.909063 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 231/446] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:53 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:54.021761 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-537d8e82-1e63-4f2e-ac0b-d4a0575276af tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:54.029849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-537d8e82-1e63-4f2e-ac0b-d4a0575276af tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1513 microversion: 2.1 time: 0.152179 May 17 12:10:54.030428 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 216/447] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:53 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:10:54.230433 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7591b4a3-a119-4409-a1a4-4d250b238fb0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:54.231105 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7591b4a3-a119-4409-a1a4-4d250b238fb0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:54.237043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7591b4a3-a119-4409-a1a4-4d250b238fb0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:54.237471 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7591b4a3-a119-4409-a1a4-4d250b238fb0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:54.238227 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7591b4a3-a119-4409-a1a4-4d250b238fb0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:54.238655 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7591b4a3-a119-4409-a1a4-4d250b238fb0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:54.363067 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7591b4a3-a119-4409-a1a4-4d250b238fb0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:54.370235 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7591b4a3-a119-4409-a1a4-4d250b238fb0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.143619 May 17 12:10:54.370800 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 232/448] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:54 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:54.385640 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c44d27e7-ab79-492f-a6a3-bdcd62f1c3ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:54.386307 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c44d27e7-ab79-492f-a6a3-bdcd62f1c3ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:54.392763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c44d27e7-ab79-492f-a6a3-bdcd62f1c3ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:54.393216 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c44d27e7-ab79-492f-a6a3-bdcd62f1c3ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:54.394022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c44d27e7-ab79-492f-a6a3-bdcd62f1c3ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:54.394463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c44d27e7-ab79-492f-a6a3-bdcd62f1c3ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:54.522801 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c44d27e7-ab79-492f-a6a3-bdcd62f1c3ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:54.531515 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c44d27e7-ab79-492f-a6a3-bdcd62f1c3ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.149603 May 17 12:10:54.550363 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 217/449] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:54 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:54.926726 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e2e22d15-c504-43d6-bea8-2aff449ea0e2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:54.927363 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e2e22d15-c504-43d6-bea8-2aff449ea0e2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:54.933670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e2e22d15-c504-43d6-bea8-2aff449ea0e2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:54.934750 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e2e22d15-c504-43d6-bea8-2aff449ea0e2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:54.935507 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e2e22d15-c504-43d6-bea8-2aff449ea0e2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:54.935938 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e2e22d15-c504-43d6-bea8-2aff449ea0e2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:55.047432 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-22d386ce-715b-4258-ae01-c654f033b4b2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:55.048146 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-22d386ce-715b-4258-ae01-c654f033b4b2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:55.054478 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-22d386ce-715b-4258-ae01-c654f033b4b2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:55.054923 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-22d386ce-715b-4258-ae01-c654f033b4b2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:55.055691 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-22d386ce-715b-4258-ae01-c654f033b4b2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:55.056125 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-22d386ce-715b-4258-ae01-c654f033b4b2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:55.066612 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e2e22d15-c504-43d6-bea8-2aff449ea0e2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:55.074943 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e2e22d15-c504-43d6-bea8-2aff449ea0e2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:55.076589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e2e22d15-c504-43d6-bea8-2aff449ea0e2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:55.077733 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e2e22d15-c504-43d6-bea8-2aff449ea0e2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1739 microversion: 2.20 time: 0.154870 May 17 12:10:55.078294 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 233/450] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:54 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:55.184758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-22d386ce-715b-4258-ae01-c654f033b4b2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:55.192065 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-22d386ce-715b-4258-ae01-c654f033b4b2 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1513 microversion: 2.1 time: 0.149228 May 17 12:10:55.192670 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 218/451] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:55 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:10:55.387384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f4bb3f00-1b21-4565-b0bf-2cabc80580a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:55.388023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f4bb3f00-1b21-4565-b0bf-2cabc80580a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:55.393836 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f4bb3f00-1b21-4565-b0bf-2cabc80580a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:55.394287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f4bb3f00-1b21-4565-b0bf-2cabc80580a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:55.395043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f4bb3f00-1b21-4565-b0bf-2cabc80580a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:55.395498 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f4bb3f00-1b21-4565-b0bf-2cabc80580a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:55.525383 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f4bb3f00-1b21-4565-b0bf-2cabc80580a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:55.535031 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f4bb3f00-1b21-4565-b0bf-2cabc80580a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.151435 May 17 12:10:55.535631 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 234/452] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:55 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:55.548663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-777c2569-6e03-4e27-b98b-84f1888e939f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:55.549278 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-777c2569-6e03-4e27-b98b-84f1888e939f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:55.555211 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-777c2569-6e03-4e27-b98b-84f1888e939f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:55.555665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-777c2569-6e03-4e27-b98b-84f1888e939f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:55.556460 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-777c2569-6e03-4e27-b98b-84f1888e939f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:55.557005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-777c2569-6e03-4e27-b98b-84f1888e939f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:55.682662 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-777c2569-6e03-4e27-b98b-84f1888e939f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:55.690710 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-777c2569-6e03-4e27-b98b-84f1888e939f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.145823 May 17 12:10:55.691289 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 219/453] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:55 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:56.095467 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-61ea1896-9e3e-446d-a7a7-6615c44d93b8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:56.096482 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-61ea1896-9e3e-446d-a7a7-6615c44d93b8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:56.102958 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-61ea1896-9e3e-446d-a7a7-6615c44d93b8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:56.103485 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-61ea1896-9e3e-446d-a7a7-6615c44d93b8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:56.104551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-61ea1896-9e3e-446d-a7a7-6615c44d93b8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:56.105079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-61ea1896-9e3e-446d-a7a7-6615c44d93b8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:56.211457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-09f31059-7e15-4f41-a5f5-10d299461d0b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:56.212389 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-09f31059-7e15-4f41-a5f5-10d299461d0b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:56.219493 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-09f31059-7e15-4f41-a5f5-10d299461d0b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:56.220097 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-09f31059-7e15-4f41-a5f5-10d299461d0b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:56.221048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-09f31059-7e15-4f41-a5f5-10d299461d0b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:56.221589 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-09f31059-7e15-4f41-a5f5-10d299461d0b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:56.508041 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-09f31059-7e15-4f41-a5f5-10d299461d0b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:56.516888 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-09f31059-7e15-4f41-a5f5-10d299461d0b tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1513 microversion: 2.1 time: 0.309407 May 17 12:10:56.517476 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 220/454] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:56 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1513 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:10:56.552338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f7dfab78-c80b-4b07-85b6-e804cf75795d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:56.553009 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f7dfab78-c80b-4b07-85b6-e804cf75795d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:56.560481 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f7dfab78-c80b-4b07-85b6-e804cf75795d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:56.560995 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f7dfab78-c80b-4b07-85b6-e804cf75795d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:56.561818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f7dfab78-c80b-4b07-85b6-e804cf75795d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:56.562738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f7dfab78-c80b-4b07-85b6-e804cf75795d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:56.590987 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-61ea1896-9e3e-446d-a7a7-6615c44d93b8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:56.600114 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-61ea1896-9e3e-446d-a7a7-6615c44d93b8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:56.601787 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-61ea1896-9e3e-446d-a7a7-6615c44d93b8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:56.602949 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-61ea1896-9e3e-446d-a7a7-6615c44d93b8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1721 microversion: 2.20 time: 0.511513 May 17 12:10:56.603514 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 235/455] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:56 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1721 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:56.713692 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d9539a64-3f23-4c2c-8872-ac29b958a59e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:56.714402 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d9539a64-3f23-4c2c-8872-ac29b958a59e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:56.727948 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d9539a64-3f23-4c2c-8872-ac29b958a59e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:56.728443 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d9539a64-3f23-4c2c-8872-ac29b958a59e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:56.730711 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d9539a64-3f23-4c2c-8872-ac29b958a59e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:56.731770 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d9539a64-3f23-4c2c-8872-ac29b958a59e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:56.782802 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f7dfab78-c80b-4b07-85b6-e804cf75795d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:56.790795 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f7dfab78-c80b-4b07-85b6-e804cf75795d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.242399 May 17 12:10:56.791591 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 221/456] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:56 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:56.885284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-727c30e9-3a91-4e90-9434-db75c81b35f2 req-4bcaf506-c5c1-4057-abb0-5a27c61dd04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92cb2fa3-d151-4e91-8621-eff4576bd14b", "name": "network-vif-deleted", "tag": "6ad7b5f7-23e1-4c95-a6e0-f49e836af232"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:56.893261 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-727c30e9-3a91-4e90-9434-db75c81b35f2 req-4bcaf506-c5c1-4057-abb0-5a27c61dd04e service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:56.893712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-727c30e9-3a91-4e90-9434-db75c81b35f2 req-4bcaf506-c5c1-4057-abb0-5a27c61dd04e service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:56.905528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-727c30e9-3a91-4e90-9434-db75c81b35f2 req-4bcaf506-c5c1-4057-abb0-5a27c61dd04e service nova] Creating event network-vif-deleted:6ad7b5f7-23e1-4c95-a6e0-f49e836af232 for instance 92cb2fa3-d151-4e91-8621-eff4576bd14b on hv-cinder-83769 May 17 12:10:56.910505 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-727c30e9-3a91-4e90-9434-db75c81b35f2 req-4bcaf506-c5c1-4057-abb0-5a27c61dd04e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028748 May 17 12:10:56.911125 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 222/457] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:10:56.928625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d9539a64-3f23-4c2c-8872-ac29b958a59e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:56.936443 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d9539a64-3f23-4c2c-8872-ac29b958a59e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.232392 May 17 12:10:56.937009 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 236/458] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:56 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:10:57.322636 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-133c47c9-c7f2-4ea1-920b-b977dbb73f9e req-dff2c1d4-8134-4d1b-86c1-133cffc4f417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3692e0a7-74c5-43c9-8047-bc13959c2db7", "name": "network-vif-plugged", "status": "completed", "tag": "7506035a-9a00-4a41-add4-17fb7a9190e6"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:57.332062 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-133c47c9-c7f2-4ea1-920b-b977dbb73f9e req-dff2c1d4-8134-4d1b-86c1-133cffc4f417 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:57.332524 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-133c47c9-c7f2-4ea1-920b-b977dbb73f9e req-dff2c1d4-8134-4d1b-86c1-133cffc4f417 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:57.345104 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-133c47c9-c7f2-4ea1-920b-b977dbb73f9e req-dff2c1d4-8134-4d1b-86c1-133cffc4f417 service nova] Creating event network-vif-plugged:7506035a-9a00-4a41-add4-17fb7a9190e6 for instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 on hv-cinder-83769 May 17 12:10:57.350173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-133c47c9-c7f2-4ea1-920b-b977dbb73f9e req-dff2c1d4-8134-4d1b-86c1-133cffc4f417 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032243 May 17 12:10:57.350939 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 223/459] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:10:57.534828 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-672ca73c-766b-4835-8e82-424a2667e39a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:57.535447 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-672ca73c-766b-4835-8e82-424a2667e39a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:57.542055 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-672ca73c-766b-4835-8e82-424a2667e39a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:57.542511 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-672ca73c-766b-4835-8e82-424a2667e39a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:57.543296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-672ca73c-766b-4835-8e82-424a2667e39a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:57.543810 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-672ca73c-766b-4835-8e82-424a2667e39a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:57.606531 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-672ca73c-766b-4835-8e82-424a2667e39a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:57.613754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-672ca73c-766b-4835-8e82-424a2667e39a tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1471 microversion: 2.1 time: 0.083579 May 17 12:10:57.614324 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 237/460] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:57 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1471 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:57.623183 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-414cb538-f75b-4b82-bc85-e698ed79bfa7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:57.623900 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-414cb538-f75b-4b82-bc85-e698ed79bfa7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:57.630029 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-414cb538-f75b-4b82-bc85-e698ed79bfa7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:57.630480 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-414cb538-f75b-4b82-bc85-e698ed79bfa7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:57.631244 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-414cb538-f75b-4b82-bc85-e698ed79bfa7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:57.631754 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-414cb538-f75b-4b82-bc85-e698ed79bfa7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:57.759306 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-414cb538-f75b-4b82-bc85-e698ed79bfa7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:57.767180 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-414cb538-f75b-4b82-bc85-e698ed79bfa7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:57.768712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-414cb538-f75b-4b82-bc85-e698ed79bfa7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:57.769854 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-414cb538-f75b-4b82-bc85-e698ed79bfa7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1721 microversion: 2.20 time: 0.151511 May 17 12:10:57.770414 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 224/461] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:57 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:57.808515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5b15df2c-a249-4524-bebe-58bc9d372fb9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:57.809750 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5b15df2c-a249-4524-bebe-58bc9d372fb9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:57.815604 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b15df2c-a249-4524-bebe-58bc9d372fb9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:57.816050 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b15df2c-a249-4524-bebe-58bc9d372fb9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:57.816847 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b15df2c-a249-4524-bebe-58bc9d372fb9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:57.817277 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b15df2c-a249-4524-bebe-58bc9d372fb9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:57.941073 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5b15df2c-a249-4524-bebe-58bc9d372fb9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:57.948866 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5b15df2c-a249-4524-bebe-58bc9d372fb9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.144161 May 17 12:10:57.949604 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 238/462] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:57 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:57.953276 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a788b93b-e982-4f25-91b9-e70c495c0824 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:57.953895 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a788b93b-e982-4f25-91b9-e70c495c0824 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:57.959925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a788b93b-e982-4f25-91b9-e70c495c0824 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:57.960362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a788b93b-e982-4f25-91b9-e70c495c0824 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:57.961164 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a788b93b-e982-4f25-91b9-e70c495c0824 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:57.961603 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a788b93b-e982-4f25-91b9-e70c495c0824 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:58.089541 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a788b93b-e982-4f25-91b9-e70c495c0824 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:58.097865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a788b93b-e982-4f25-91b9-e70c495c0824 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.148487 May 17 12:10:58.098439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 225/463] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:57 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:10:58.630909 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7c1f3c11-df5d-4959-b297-9f8f39601f43 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:58.631557 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7c1f3c11-df5d-4959-b297-9f8f39601f43 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:58.638460 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7c1f3c11-df5d-4959-b297-9f8f39601f43 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:58.638909 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7c1f3c11-df5d-4959-b297-9f8f39601f43 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:58.639668 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7c1f3c11-df5d-4959-b297-9f8f39601f43 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:58.640103 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7c1f3c11-df5d-4959-b297-9f8f39601f43 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:58.701451 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7c1f3c11-df5d-4959-b297-9f8f39601f43 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:58.708711 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7c1f3c11-df5d-4959-b297-9f8f39601f43 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1303 microversion: 2.1 time: 0.081652 May 17 12:10:58.709285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 239/464] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:58 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1303 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:58.788278 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8eee2486-3cac-4abb-a132-b8a558742f4e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:58.788977 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8eee2486-3cac-4abb-a132-b8a558742f4e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:58.797488 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8eee2486-3cac-4abb-a132-b8a558742f4e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:58.797488 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8eee2486-3cac-4abb-a132-b8a558742f4e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:58.797888 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8eee2486-3cac-4abb-a132-b8a558742f4e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:58.798384 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8eee2486-3cac-4abb-a132-b8a558742f4e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:58.946242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8eee2486-3cac-4abb-a132-b8a558742f4e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:58.954923 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8eee2486-3cac-4abb-a132-b8a558742f4e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:58.956768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8eee2486-3cac-4abb-a132-b8a558742f4e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:58.959604 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8eee2486-3cac-4abb-a132-b8a558742f4e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1721 microversion: 2.20 time: 0.175246 May 17 12:10:58.960203 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 226/465] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:58 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:10:58.964739 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-269deae7-9533-4c74-93f4-09aa667001d8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:58.966312 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-269deae7-9533-4c74-93f4-09aa667001d8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:58.972741 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-269deae7-9533-4c74-93f4-09aa667001d8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:58.973191 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-269deae7-9533-4c74-93f4-09aa667001d8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:58.973963 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-269deae7-9533-4c74-93f4-09aa667001d8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:58.974419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-269deae7-9533-4c74-93f4-09aa667001d8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:59.115747 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2697c207-f4ba-4aef-b78c-095a7fb61be3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:59.116437 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2697c207-f4ba-4aef-b78c-095a7fb61be3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:59.121373 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-269deae7-9533-4c74-93f4-09aa667001d8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:59.122466 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2697c207-f4ba-4aef-b78c-095a7fb61be3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:59.122894 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2697c207-f4ba-4aef-b78c-095a7fb61be3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:59.123663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2697c207-f4ba-4aef-b78c-095a7fb61be3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:59.124097 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2697c207-f4ba-4aef-b78c-095a7fb61be3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:59.129017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-269deae7-9533-4c74-93f4-09aa667001d8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.168181 May 17 12:10:59.129595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 240/466] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:58 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:10:59.251309 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2697c207-f4ba-4aef-b78c-095a7fb61be3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:59.259042 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2697c207-f4ba-4aef-b78c-095a7fb61be3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.147017 May 17 12:10:59.259609 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 227/467] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:59 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:10:59.376062 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-a101ae8b-002d-42c9-bc04-ddaf564fc33f req-8ebee729-99d9-49dd-ad7b-ae0da5e126ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d883f923-082e-4ee1-ba3e-0975ba2d7409", "name": "network-vif-unplugged", "status": "completed", "tag": "cf6ad775-daff-4e4a-b3ee-b4652d53fdfe"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:10:59.384318 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-a101ae8b-002d-42c9-bc04-ddaf564fc33f req-8ebee729-99d9-49dd-ad7b-ae0da5e126ec service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:59.384761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-a101ae8b-002d-42c9-bc04-ddaf564fc33f req-8ebee729-99d9-49dd-ad7b-ae0da5e126ec service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:59.395921 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-a101ae8b-002d-42c9-bc04-ddaf564fc33f req-8ebee729-99d9-49dd-ad7b-ae0da5e126ec service nova] Creating event network-vif-unplugged:cf6ad775-daff-4e4a-b3ee-b4652d53fdfe for instance d883f923-082e-4ee1-ba3e-0975ba2d7409 on hv-cinder-83769 May 17 12:10:59.401056 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-a101ae8b-002d-42c9-bc04-ddaf564fc33f req-8ebee729-99d9-49dd-ad7b-ae0da5e126ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029526 May 17 12:10:59.401684 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 241/468] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:10:59.726931 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:59.727536 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:59.733392 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:59.733836 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:59.734595 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:59.735028 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:59.765518 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:59.765956 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:59.766403 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lazy-loading 'fault' on Instance uuid 92cb2fa3-d151-4e91-8621-eff4576bd14b {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:10:59.805598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45cfe92bd7641b6b78b99938767bc32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a69c8441974b4749bd43a2ccf3629332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:10:59.813370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ea5a9fc3-a5da-4623-8a9f-217b0d19c592 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 200 len: 1308 microversion: 2.1 time: 0.090349 May 17 12:10:59.813936 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 228/469] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:10:59 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:10:59.978719 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4f5ab5c0-6649-4238-a816-821968c62d85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:10:59.979424 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4f5ab5c0-6649-4238-a816-821968c62d85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:10:59.986755 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f5ab5c0-6649-4238-a816-821968c62d85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:59.987199 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f5ab5c0-6649-4238-a816-821968c62d85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:10:59.987969 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f5ab5c0-6649-4238-a816-821968c62d85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:10:59.988437 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f5ab5c0-6649-4238-a816-821968c62d85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.117113 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4f5ab5c0-6649-4238-a816-821968c62d85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:00.125742 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4f5ab5c0-6649-4238-a816-821968c62d85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:00.127258 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4f5ab5c0-6649-4238-a816-821968c62d85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:00.128456 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4f5ab5c0-6649-4238-a816-821968c62d85 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1664 microversion: 2.20 time: 0.153928 May 17 12:11:00.129019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 242/470] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:10:59 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:00.145880 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-24d7f081-cf28-4047-b114-25cc9a6718c5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:00.146245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f0f50f94-149f-4ba9-b353-fb3322fec97b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d70569f8-0bd0-46a3-936d-3114ef0936a4"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:11:00.146484 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-24d7f081-cf28-4047-b114-25cc9a6718c5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:00.147371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f0f50f94-149f-4ba9-b353-fb3322fec97b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:00.152479 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-24d7f081-cf28-4047-b114-25cc9a6718c5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.153101 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-24d7f081-cf28-4047-b114-25cc9a6718c5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.153377 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f0f50f94-149f-4ba9-b353-fb3322fec97b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.153996 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-24d7f081-cf28-4047-b114-25cc9a6718c5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.154093 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f0f50f94-149f-4ba9-b353-fb3322fec97b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.154435 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-24d7f081-cf28-4047-b114-25cc9a6718c5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.154803 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f0f50f94-149f-4ba9-b353-fb3322fec97b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.155244 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f0f50f94-149f-4ba9-b353-fb3322fec97b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.291728 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-24d7f081-cf28-4047-b114-25cc9a6718c5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:00.301586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-24d7f081-cf28-4047-b114-25cc9a6718c5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.159272 May 17 12:11:00.302853 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 243/471] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:00 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:00.307689 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e7a9bd56-3e55-4764-aef8-32cb88be8a45 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:00.308329 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e7a9bd56-3e55-4764-aef8-32cb88be8a45 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:00.315006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e7a9bd56-3e55-4764-aef8-32cb88be8a45 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.315463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e7a9bd56-3e55-4764-aef8-32cb88be8a45 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.316250 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e7a9bd56-3e55-4764-aef8-32cb88be8a45 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.316949 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e7a9bd56-3e55-4764-aef8-32cb88be8a45 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.452051 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f0f50f94-149f-4ba9-b353-fb3322fec97b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "POST /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309594 May 17 12:11:00.452918 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 229/472] 10.222.0.58 () {62 vars in 1363 bytes} [Tue May 17 12:11:00 2022] POST /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 12:11:00.457093 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e7a9bd56-3e55-4764-aef8-32cb88be8a45 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:00.465797 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e7a9bd56-3e55-4764-aef8-32cb88be8a45 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.161260 May 17 12:11:00.466427 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 244/473] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:00 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:00.568383 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-464aea38-22d1-401a-b05f-49b78687b492 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:11:00.568981 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-464aea38-22d1-401a-b05f-49b78687b492 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:00.575755 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-464aea38-22d1-401a-b05f-49b78687b492 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.576227 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-464aea38-22d1-401a-b05f-49b78687b492 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.577005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-464aea38-22d1-401a-b05f-49b78687b492 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.577443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-464aea38-22d1-401a-b05f-49b78687b492 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.665323 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-464aea38-22d1-401a-b05f-49b78687b492 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "POST /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/action" status: 202 len: 0 microversion: 2.20 time: 0.100795 May 17 12:11:00.665985 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 230/474] 10.222.0.58 () {62 vars in 1318 bytes} [Tue May 17 12:11:00 2022] POST /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 12:11:00.674694 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4bfe1c6f-f69d-42ba-a73e-c5c880159810 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:00.675401 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4bfe1c6f-f69d-42ba-a73e-c5c880159810 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:00.681587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4bfe1c6f-f69d-42ba-a73e-c5c880159810 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.682112 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4bfe1c6f-f69d-42ba-a73e-c5c880159810 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.682898 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4bfe1c6f-f69d-42ba-a73e-c5c880159810 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.683344 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4bfe1c6f-f69d-42ba-a73e-c5c880159810 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.830499 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9c7e7476-685d-4360-8e47-1023d17b3978 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:00.832006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9c7e7476-685d-4360-8e47-1023d17b3978 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] [instance: 92cb2fa3-d151-4e91-8621-eff4576bd14b] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:00.834051 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4bfe1c6f-f69d-42ba-a73e-c5c880159810 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:00.838433 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9c7e7476-685d-4360-8e47-1023d17b3978 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.839055 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9c7e7476-685d-4360-8e47-1023d17b3978 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.839998 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9c7e7476-685d-4360-8e47-1023d17b3978 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:00.840807 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9c7e7476-685d-4360-8e47-1023d17b3978 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:00.844526 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4bfe1c6f-f69d-42ba-a73e-c5c880159810 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:00.846180 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4bfe1c6f-f69d-42ba-a73e-c5c880159810 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:00.847568 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4bfe1c6f-f69d-42ba-a73e-c5c880159810 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1750 microversion: 2.20 time: 0.176812 May 17 12:11:00.848217 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 245/475] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:00 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:11:00.861363 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-9c7e7476-685d-4360-8e47-1023d17b3978 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] HTTP exception thrown: Instance 92cb2fa3-d151-4e91-8621-eff4576bd14b could not be found. May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9c7e7476-685d-4360-8e47-1023d17b3978 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Request method failure captured: May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b HTTP/1.1 May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig5AkmgOYbf1y8-9fD4QdCqatvM4ybtn3_9EaxCABSxV40zI5N8PTD123g861tLe2WKZUXsugjlu2FojhIZZ5xiGSduGjjKUZ64LbJX5VswUP-x8rXktCsRIJdpsy2THC6PUOyV5pzf2C_BoJ_dKFj1UVJJSGZB64sGg0G_xpVhhL3gk May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: a69c8441974b4749bd43a2ccf3629332 May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2056856710 May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:11:00.863123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a69c8441974b4749bd43a2ccf3629332"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a69c8441974b4749bd43a2ccf3629332", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a69c8441974b4749bd43a2ccf3629332"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a69c8441974b4749bd43a2ccf3629332"}]}] May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-VolumesSnapshotTestJSON-2056856710 May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: a69c8441974b4749bd43a2ccf3629332 May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2056856710 May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-VolumesSnapshotTestJSON-2056856710-project May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: f45cfe92bd7641b6b78b99938767bc32 May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-VolumesSnapshotTestJSON-2056856710-project May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 92cb2fa3-d151-4e91-8621-eff4576bd14b could not be found. May 17 12:11:00.864660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '92cb2fa3-d151-4e91-8621-eff4576bd14b'} May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92cb2fa3-d151-4e91-8621-eff4576bd14b could not be found. May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:11:00.865521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92cb2fa3-d151-4e91-8621-eff4576bd14b could not be found. May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92cb2fa3-d151-4e91-8621-eff4576bd14b could not be found. May 17 12:11:00.866933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:11:00.871280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9c7e7476-685d-4360-8e47-1023d17b3978 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] Returning 404 to user: Instance 92cb2fa3-d151-4e91-8621-eff4576bd14b could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:11:00.871280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-9c7e7476-685d-4360-8e47-1023d17b3978 tempest-VolumesSnapshotTestJSON-2056856710 tempest-VolumesSnapshotTestJSON-2056856710-project] 10.222.0.58 "GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b" status: 404 len: 111 microversion: 2.1 time: 0.039410 May 17 12:11:00.871280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 231/476] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:00 2022] GET /compute/v2.1/servers/92cb2fa3-d151-4e91-8621-eff4576bd14b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:11:01.320425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1d0e40d7-d6e5-4fa5-bf7a-8dfc82a02f75 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:01.321044 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1d0e40d7-d6e5-4fa5-bf7a-8dfc82a02f75 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:01.328539 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d0e40d7-d6e5-4fa5-bf7a-8dfc82a02f75 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:01.328997 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d0e40d7-d6e5-4fa5-bf7a-8dfc82a02f75 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:01.329780 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d0e40d7-d6e5-4fa5-bf7a-8dfc82a02f75 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:01.330220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d0e40d7-d6e5-4fa5-bf7a-8dfc82a02f75 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:01.486289 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-19015fd7-53dd-4aca-af02-175c7060ac53 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:01.487656 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-19015fd7-53dd-4aca-af02-175c7060ac53 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:01.494014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-19015fd7-53dd-4aca-af02-175c7060ac53 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:01.494599 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-19015fd7-53dd-4aca-af02-175c7060ac53 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:01.495625 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-19015fd7-53dd-4aca-af02-175c7060ac53 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:01.496161 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-19015fd7-53dd-4aca-af02-175c7060ac53 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:01.502734 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1d0e40d7-d6e5-4fa5-bf7a-8dfc82a02f75 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:01.510818 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1d0e40d7-d6e5-4fa5-bf7a-8dfc82a02f75 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1366 microversion: 2.1 time: 0.194317 May 17 12:11:01.511558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 246/477] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:01 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:01.643819 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-19015fd7-53dd-4aca-af02-175c7060ac53 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:01.652395 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-19015fd7-53dd-4aca-af02-175c7060ac53 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.173337 May 17 12:11:01.654280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 232/478] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:01 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:11:01.866258 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-af418dae-769d-452a-be74-ec9fd781d514 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:01.866869 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-af418dae-769d-452a-be74-ec9fd781d514 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:01.873263 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-af418dae-769d-452a-be74-ec9fd781d514 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:01.873708 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-af418dae-769d-452a-be74-ec9fd781d514 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:01.874472 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-af418dae-769d-452a-be74-ec9fd781d514 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:01.874908 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-af418dae-769d-452a-be74-ec9fd781d514 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:02.008341 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-af418dae-769d-452a-be74-ec9fd781d514 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:02.017765 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-af418dae-769d-452a-be74-ec9fd781d514 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:02.019344 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-af418dae-769d-452a-be74-ec9fd781d514 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:02.020650 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-af418dae-769d-452a-be74-ec9fd781d514 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1750 microversion: 2.20 time: 0.158596 May 17 12:11:02.021318 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 247/479] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:01 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:02.526793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-237f5f1a-9c45-4db7-9f1d-77a2607a431a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:02.527412 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-237f5f1a-9c45-4db7-9f1d-77a2607a431a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:02.533967 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-237f5f1a-9c45-4db7-9f1d-77a2607a431a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:02.534418 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-237f5f1a-9c45-4db7-9f1d-77a2607a431a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:02.535197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-237f5f1a-9c45-4db7-9f1d-77a2607a431a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:02.535641 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-237f5f1a-9c45-4db7-9f1d-77a2607a431a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:02.666740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-237f5f1a-9c45-4db7-9f1d-77a2607a431a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:02.671339 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1e9e7567-46f5-48b0-8d4c-d90da2fa3977 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:02.671958 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1e9e7567-46f5-48b0-8d4c-d90da2fa3977 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:02.674799 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-237f5f1a-9c45-4db7-9f1d-77a2607a431a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1555 microversion: 2.1 time: 0.151856 May 17 12:11:02.675367 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 233/480] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:02 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:02.678217 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1e9e7567-46f5-48b0-8d4c-d90da2fa3977 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:02.678674 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1e9e7567-46f5-48b0-8d4c-d90da2fa3977 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:02.679450 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1e9e7567-46f5-48b0-8d4c-d90da2fa3977 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:02.679890 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1e9e7567-46f5-48b0-8d4c-d90da2fa3977 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:02.690925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-27b0a0b0-9d48-4868-b3dd-9b7fa6dc318b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:02.691432 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-27b0a0b0-9d48-4868-b3dd-9b7fa6dc318b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:02.697572 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-27b0a0b0-9d48-4868-b3dd-9b7fa6dc318b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:02.698017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-27b0a0b0-9d48-4868-b3dd-9b7fa6dc318b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:02.698777 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-27b0a0b0-9d48-4868-b3dd-9b7fa6dc318b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:02.699210 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-27b0a0b0-9d48-4868-b3dd-9b7fa6dc318b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:02.783443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-27b0a0b0-9d48-4868-b3dd-9b7fa6dc318b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096233 May 17 12:11:02.784120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 234/481] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 17 12:11:02 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:11:02.822095 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1e9e7567-46f5-48b0-8d4c-d90da2fa3977 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:02.830326 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1e9e7567-46f5-48b0-8d4c-d90da2fa3977 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.163526 May 17 12:11:02.831104 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 248/482] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:02 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:11:03.039003 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b00073e1-72b0-4260-9de3-60c20b7e8c7c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:03.039536 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b00073e1-72b0-4260-9de3-60c20b7e8c7c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:03.045948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b00073e1-72b0-4260-9de3-60c20b7e8c7c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:03.046400 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b00073e1-72b0-4260-9de3-60c20b7e8c7c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:03.047173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b00073e1-72b0-4260-9de3-60c20b7e8c7c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:03.047610 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b00073e1-72b0-4260-9de3-60c20b7e8c7c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:03.277245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b00073e1-72b0-4260-9de3-60c20b7e8c7c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:03.286058 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b00073e1-72b0-4260-9de3-60c20b7e8c7c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:03.287570 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b00073e1-72b0-4260-9de3-60c20b7e8c7c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:03.288769 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b00073e1-72b0-4260-9de3-60c20b7e8c7c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1752 microversion: 2.20 time: 0.253816 May 17 12:11:03.289385 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 235/483] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:03 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1752 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:03.759998 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-4ac99ff6-bc47-46ba-a8e7-c7e181d98105 req-b917d611-61a0-448c-8c49-0d04916e7964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3692e0a7-74c5-43c9-8047-bc13959c2db7", "tag": "7506035a-9a00-4a41-add4-17fb7a9190e6"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:11:03.768417 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-4ac99ff6-bc47-46ba-a8e7-c7e181d98105 req-b917d611-61a0-448c-8c49-0d04916e7964 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:03.768862 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-4ac99ff6-bc47-46ba-a8e7-c7e181d98105 req-b917d611-61a0-448c-8c49-0d04916e7964 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:03.779429 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-4ac99ff6-bc47-46ba-a8e7-c7e181d98105 req-b917d611-61a0-448c-8c49-0d04916e7964 service nova] Creating event network-changed:7506035a-9a00-4a41-add4-17fb7a9190e6 for instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 on hv-cinder-83769 May 17 12:11:03.784659 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-4ac99ff6-bc47-46ba-a8e7-c7e181d98105 req-b917d611-61a0-448c-8c49-0d04916e7964 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028114 May 17 12:11:03.785368 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 249/484] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:11:03.847295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-12622c33-c47a-41dd-ab1f-22be69f7ce66 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:03.847909 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-12622c33-c47a-41dd-ab1f-22be69f7ce66 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:03.854260 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12622c33-c47a-41dd-ab1f-22be69f7ce66 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:03.854710 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12622c33-c47a-41dd-ab1f-22be69f7ce66 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:03.855480 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12622c33-c47a-41dd-ab1f-22be69f7ce66 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:03.856050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12622c33-c47a-41dd-ab1f-22be69f7ce66 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:03.984682 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-12622c33-c47a-41dd-ab1f-22be69f7ce66 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:03.992617 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-12622c33-c47a-41dd-ab1f-22be69f7ce66 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.149122 May 17 12:11:03.993220 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 236/485] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:03 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:04.307578 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6d371a0c-4632-4d6e-ba3e-2ff84f509fcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:04.308208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6d371a0c-4632-4d6e-ba3e-2ff84f509fcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:04.314765 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6d371a0c-4632-4d6e-ba3e-2ff84f509fcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:04.315216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6d371a0c-4632-4d6e-ba3e-2ff84f509fcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:04.316017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6d371a0c-4632-4d6e-ba3e-2ff84f509fcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:04.316484 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6d371a0c-4632-4d6e-ba3e-2ff84f509fcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:04.452085 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6d371a0c-4632-4d6e-ba3e-2ff84f509fcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:04.460672 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6d371a0c-4632-4d6e-ba3e-2ff84f509fcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:04.462200 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6d371a0c-4632-4d6e-ba3e-2ff84f509fcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:04.463368 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6d371a0c-4632-4d6e-ba3e-2ff84f509fcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1752 microversion: 2.20 time: 0.160090 May 17 12:11:04.463932 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 250/486] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:04 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:05.009062 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-54bbb2fc-6fde-49af-ad76-0a05fc7ce69d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:05.009675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-54bbb2fc-6fde-49af-ad76-0a05fc7ce69d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:05.015892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-54bbb2fc-6fde-49af-ad76-0a05fc7ce69d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:05.016372 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-54bbb2fc-6fde-49af-ad76-0a05fc7ce69d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:05.017131 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-54bbb2fc-6fde-49af-ad76-0a05fc7ce69d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:05.017563 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-54bbb2fc-6fde-49af-ad76-0a05fc7ce69d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:05.144219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-54bbb2fc-6fde-49af-ad76-0a05fc7ce69d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:05.152278 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-54bbb2fc-6fde-49af-ad76-0a05fc7ce69d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.146991 May 17 12:11:05.153363 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 237/487] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:05 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:05.481347 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cfa580cf-8e1a-49ef-9dc6-4baba00665c0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:05.481954 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cfa580cf-8e1a-49ef-9dc6-4baba00665c0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:05.488206 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cfa580cf-8e1a-49ef-9dc6-4baba00665c0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:05.488664 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cfa580cf-8e1a-49ef-9dc6-4baba00665c0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:05.489425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cfa580cf-8e1a-49ef-9dc6-4baba00665c0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:05.489860 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cfa580cf-8e1a-49ef-9dc6-4baba00665c0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:05.617875 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cfa580cf-8e1a-49ef-9dc6-4baba00665c0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:05.627082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cfa580cf-8e1a-49ef-9dc6-4baba00665c0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:05.628605 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cfa580cf-8e1a-49ef-9dc6-4baba00665c0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:05.629761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cfa580cf-8e1a-49ef-9dc6-4baba00665c0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1752 microversion: 2.20 time: 0.152246 May 17 12:11:05.630312 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 251/488] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:05 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:06.170438 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-16510fbe-f04a-493d-9502-aa98ab08fe43 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:06.171054 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-16510fbe-f04a-493d-9502-aa98ab08fe43 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:06.177488 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-16510fbe-f04a-493d-9502-aa98ab08fe43 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:06.177939 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-16510fbe-f04a-493d-9502-aa98ab08fe43 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:06.178712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-16510fbe-f04a-493d-9502-aa98ab08fe43 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:06.179150 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-16510fbe-f04a-493d-9502-aa98ab08fe43 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:06.306281 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-16510fbe-f04a-493d-9502-aa98ab08fe43 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:06.314702 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-16510fbe-f04a-493d-9502-aa98ab08fe43 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.148644 May 17 12:11:06.315270 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 238/489] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:06 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:06.648388 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-193353a7-2534-471a-8c05-a52f9c8514ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:06.650098 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-193353a7-2534-471a-8c05-a52f9c8514ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:06.656673 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-193353a7-2534-471a-8c05-a52f9c8514ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:06.657120 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-193353a7-2534-471a-8c05-a52f9c8514ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:06.657888 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-193353a7-2534-471a-8c05-a52f9c8514ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:06.658321 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-193353a7-2534-471a-8c05-a52f9c8514ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:06.871077 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-193353a7-2534-471a-8c05-a52f9c8514ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:06.879746 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-193353a7-2534-471a-8c05-a52f9c8514ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:06.881283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-193353a7-2534-471a-8c05-a52f9c8514ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:06.882435 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-193353a7-2534-471a-8c05-a52f9c8514ac tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1752 microversion: 2.20 time: 0.238080 May 17 12:11:06.883420 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 252/490] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:06 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1752 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:07.332355 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-81b10111-50e0-405f-bc3b-99d6a135e6e8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:07.332925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-81b10111-50e0-405f-bc3b-99d6a135e6e8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:07.339242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-81b10111-50e0-405f-bc3b-99d6a135e6e8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:07.339693 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-81b10111-50e0-405f-bc3b-99d6a135e6e8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:07.340654 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-81b10111-50e0-405f-bc3b-99d6a135e6e8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:07.341100 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-81b10111-50e0-405f-bc3b-99d6a135e6e8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:07.472113 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-81b10111-50e0-405f-bc3b-99d6a135e6e8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:07.480306 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-81b10111-50e0-405f-bc3b-99d6a135e6e8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.152080 May 17 12:11:07.481523 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 239/491] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:07 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:07.901330 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c3f3186d-245e-47e7-bda6-e67a22e96b49 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:07.901939 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c3f3186d-245e-47e7-bda6-e67a22e96b49 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:07.908964 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3f3186d-245e-47e7-bda6-e67a22e96b49 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:07.909411 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3f3186d-245e-47e7-bda6-e67a22e96b49 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:07.910172 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3f3186d-245e-47e7-bda6-e67a22e96b49 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:07.910607 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3f3186d-245e-47e7-bda6-e67a22e96b49 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:08.040951 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c3f3186d-245e-47e7-bda6-e67a22e96b49 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:08.049758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c3f3186d-245e-47e7-bda6-e67a22e96b49 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:08.051238 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c3f3186d-245e-47e7-bda6-e67a22e96b49 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:08.052417 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c3f3186d-245e-47e7-bda6-e67a22e96b49 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.154917 May 17 12:11:08.052983 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 253/492] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:07 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:08.498028 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1d800249-0137-4281-a059-775851fb4a70 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:08.498649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1d800249-0137-4281-a059-775851fb4a70 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:08.505157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1d800249-0137-4281-a059-775851fb4a70 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:08.505611 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1d800249-0137-4281-a059-775851fb4a70 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:08.506399 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1d800249-0137-4281-a059-775851fb4a70 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:08.506837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1d800249-0137-4281-a059-775851fb4a70 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:08.646448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1d800249-0137-4281-a059-775851fb4a70 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:08.654428 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1d800249-0137-4281-a059-775851fb4a70 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.160245 May 17 12:11:08.655026 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 240/493] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:08 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:09.070007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-15b6252f-d663-42f1-af21-81ad3c769368 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:09.070610 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-15b6252f-d663-42f1-af21-81ad3c769368 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:09.077378 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-15b6252f-d663-42f1-af21-81ad3c769368 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:09.077825 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-15b6252f-d663-42f1-af21-81ad3c769368 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:09.078585 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-15b6252f-d663-42f1-af21-81ad3c769368 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:09.079019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-15b6252f-d663-42f1-af21-81ad3c769368 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:09.227910 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-15b6252f-d663-42f1-af21-81ad3c769368 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:09.241304 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-15b6252f-d663-42f1-af21-81ad3c769368 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:09.243334 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-15b6252f-d663-42f1-af21-81ad3c769368 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:09.244989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-15b6252f-d663-42f1-af21-81ad3c769368 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.178599 May 17 12:11:09.246029 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 254/494] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:09 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:09.671087 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-12caee66-1f0c-478e-bd7d-4f479995d730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:09.671701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-12caee66-1f0c-478e-bd7d-4f479995d730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:09.678001 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12caee66-1f0c-478e-bd7d-4f479995d730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:09.678447 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12caee66-1f0c-478e-bd7d-4f479995d730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:09.679215 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12caee66-1f0c-478e-bd7d-4f479995d730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:09.679645 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12caee66-1f0c-478e-bd7d-4f479995d730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:09.831065 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-12caee66-1f0c-478e-bd7d-4f479995d730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:09.839240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-12caee66-1f0c-478e-bd7d-4f479995d730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.172193 May 17 12:11:09.839819 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 241/495] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:09 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:10.266215 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3db3acc8-51bb-434e-9d2a-52557554d74a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:10.266834 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3db3acc8-51bb-434e-9d2a-52557554d74a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:10.273394 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3db3acc8-51bb-434e-9d2a-52557554d74a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:10.273847 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3db3acc8-51bb-434e-9d2a-52557554d74a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:10.274623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3db3acc8-51bb-434e-9d2a-52557554d74a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:10.275056 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3db3acc8-51bb-434e-9d2a-52557554d74a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:10.411275 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3db3acc8-51bb-434e-9d2a-52557554d74a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:10.419506 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3db3acc8-51bb-434e-9d2a-52557554d74a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:10.421028 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3db3acc8-51bb-434e-9d2a-52557554d74a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:10.422172 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3db3acc8-51bb-434e-9d2a-52557554d74a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.160408 May 17 12:11:10.422732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 255/496] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:10 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:10.858072 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ff293ca7-7d79-45f0-a4be-98942a93a41a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:10.858716 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ff293ca7-7d79-45f0-a4be-98942a93a41a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:10.864880 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ff293ca7-7d79-45f0-a4be-98942a93a41a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:10.865323 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ff293ca7-7d79-45f0-a4be-98942a93a41a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:10.866079 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ff293ca7-7d79-45f0-a4be-98942a93a41a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:10.866512 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ff293ca7-7d79-45f0-a4be-98942a93a41a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:11.002005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ff293ca7-7d79-45f0-a4be-98942a93a41a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:11.010495 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ff293ca7-7d79-45f0-a4be-98942a93a41a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.157049 May 17 12:11:11.011648 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 242/497] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:10 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:11:11.445144 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3f228da8-d493-4539-93cb-e7ce5c4e40d2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:11.445833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3f228da8-d493-4539-93cb-e7ce5c4e40d2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:11.453489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3f228da8-d493-4539-93cb-e7ce5c4e40d2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:11.453937 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3f228da8-d493-4539-93cb-e7ce5c4e40d2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:11.454710 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3f228da8-d493-4539-93cb-e7ce5c4e40d2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:11.455146 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3f228da8-d493-4539-93cb-e7ce5c4e40d2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:11.587191 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3f228da8-d493-4539-93cb-e7ce5c4e40d2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:11.597144 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3f228da8-d493-4539-93cb-e7ce5c4e40d2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:11.598725 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3f228da8-d493-4539-93cb-e7ce5c4e40d2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:11.599886 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3f228da8-d493-4539-93cb-e7ce5c4e40d2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.158978 May 17 12:11:11.600483 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 256/498] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:11 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:12.028654 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-90bb08f2-b558-4f85-8480-20a2b743a885 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:12.029371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-90bb08f2-b558-4f85-8480-20a2b743a885 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:12.036006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-90bb08f2-b558-4f85-8480-20a2b743a885 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:12.036491 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-90bb08f2-b558-4f85-8480-20a2b743a885 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:12.037471 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-90bb08f2-b558-4f85-8480-20a2b743a885 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:12.037912 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-90bb08f2-b558-4f85-8480-20a2b743a885 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:12.171131 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-90bb08f2-b558-4f85-8480-20a2b743a885 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:12.179196 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-90bb08f2-b558-4f85-8480-20a2b743a885 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.155263 May 17 12:11:12.179784 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 243/499] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:12 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:12.619105 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-655582f4-eece-44f8-b73c-3a4303f87117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:12.619669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-655582f4-eece-44f8-b73c-3a4303f87117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:12.626035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-655582f4-eece-44f8-b73c-3a4303f87117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:12.626492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-655582f4-eece-44f8-b73c-3a4303f87117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:12.627264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-655582f4-eece-44f8-b73c-3a4303f87117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:12.627706 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-655582f4-eece-44f8-b73c-3a4303f87117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:12.772658 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-655582f4-eece-44f8-b73c-3a4303f87117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:12.780955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-655582f4-eece-44f8-b73c-3a4303f87117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:12.782441 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-655582f4-eece-44f8-b73c-3a4303f87117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:12.783577 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-655582f4-eece-44f8-b73c-3a4303f87117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.168662 May 17 12:11:12.784135 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 257/500] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:12 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:13.198055 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4f4bbce9-b835-41b6-bc57-122af0447eb5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:13.198766 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4f4bbce9-b835-41b6-bc57-122af0447eb5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:13.205267 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4f4bbce9-b835-41b6-bc57-122af0447eb5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:13.205714 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4f4bbce9-b835-41b6-bc57-122af0447eb5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:13.206548 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4f4bbce9-b835-41b6-bc57-122af0447eb5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:13.207012 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4f4bbce9-b835-41b6-bc57-122af0447eb5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:13.346771 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4f4bbce9-b835-41b6-bc57-122af0447eb5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:13.354763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4f4bbce9-b835-41b6-bc57-122af0447eb5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.161470 May 17 12:11:13.355342 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 244/501] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:13 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:13.807131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-dcb60e32-d914-4d65-9ff9-8274163eaf1f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:13.808058 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-dcb60e32-d914-4d65-9ff9-8274163eaf1f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:13.815999 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dcb60e32-d914-4d65-9ff9-8274163eaf1f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:13.817518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dcb60e32-d914-4d65-9ff9-8274163eaf1f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:13.818608 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dcb60e32-d914-4d65-9ff9-8274163eaf1f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:13.819296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dcb60e32-d914-4d65-9ff9-8274163eaf1f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:13.952877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-dcb60e32-d914-4d65-9ff9-8274163eaf1f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:13.961118 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-dcb60e32-d914-4d65-9ff9-8274163eaf1f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:13.962630 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-dcb60e32-d914-4d65-9ff9-8274163eaf1f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:13.963791 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-dcb60e32-d914-4d65-9ff9-8274163eaf1f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.161366 May 17 12:11:13.964384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 258/502] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:13 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:11:14.373445 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e4783f0d-9afc-47f0-ba2a-a3670b905180 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:14.374063 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e4783f0d-9afc-47f0-ba2a-a3670b905180 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:14.381196 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e4783f0d-9afc-47f0-ba2a-a3670b905180 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:14.381645 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e4783f0d-9afc-47f0-ba2a-a3670b905180 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:14.382415 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e4783f0d-9afc-47f0-ba2a-a3670b905180 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:14.382851 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e4783f0d-9afc-47f0-ba2a-a3670b905180 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:14.508359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e4783f0d-9afc-47f0-ba2a-a3670b905180 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:14.516280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e4783f0d-9afc-47f0-ba2a-a3670b905180 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.146735 May 17 12:11:14.516846 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 245/503] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:14 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:14.981940 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b388e856-acf5-4aba-9ebb-0f79ab32e1da tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:14.982551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b388e856-acf5-4aba-9ebb-0f79ab32e1da tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:14.988824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b388e856-acf5-4aba-9ebb-0f79ab32e1da tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:14.989267 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b388e856-acf5-4aba-9ebb-0f79ab32e1da tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:14.990024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b388e856-acf5-4aba-9ebb-0f79ab32e1da tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:14.990454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b388e856-acf5-4aba-9ebb-0f79ab32e1da tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:15.125761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b388e856-acf5-4aba-9ebb-0f79ab32e1da tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:15.134233 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b388e856-acf5-4aba-9ebb-0f79ab32e1da tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:15.135724 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b388e856-acf5-4aba-9ebb-0f79ab32e1da tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:15.136921 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b388e856-acf5-4aba-9ebb-0f79ab32e1da tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.159044 May 17 12:11:15.138017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 259/504] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:14 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:15.533792 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c4a3a285-9982-4f65-9e5c-ebfc21d5a412 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:15.534409 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c4a3a285-9982-4f65-9e5c-ebfc21d5a412 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:15.540818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c4a3a285-9982-4f65-9e5c-ebfc21d5a412 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:15.541271 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c4a3a285-9982-4f65-9e5c-ebfc21d5a412 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:15.542045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c4a3a285-9982-4f65-9e5c-ebfc21d5a412 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:15.542476 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c4a3a285-9982-4f65-9e5c-ebfc21d5a412 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:15.674864 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c4a3a285-9982-4f65-9e5c-ebfc21d5a412 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:15.682666 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c4a3a285-9982-4f65-9e5c-ebfc21d5a412 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.152863 May 17 12:11:15.683228 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 246/505] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:15 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:16.155707 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1c03c151-038a-469c-8d6c-4db3d4a98c55 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:16.157210 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1c03c151-038a-469c-8d6c-4db3d4a98c55 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:16.164138 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c03c151-038a-469c-8d6c-4db3d4a98c55 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:16.164617 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c03c151-038a-469c-8d6c-4db3d4a98c55 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:16.165402 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c03c151-038a-469c-8d6c-4db3d4a98c55 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:16.165839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c03c151-038a-469c-8d6c-4db3d4a98c55 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:16.301313 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1c03c151-038a-469c-8d6c-4db3d4a98c55 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:16.311233 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1c03c151-038a-469c-8d6c-4db3d4a98c55 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:16.312898 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1c03c151-038a-469c-8d6c-4db3d4a98c55 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:16.314156 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1c03c151-038a-469c-8d6c-4db3d4a98c55 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.163136 May 17 12:11:16.314944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 260/506] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:16 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:16.701665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-28f86eba-281d-4f6f-9997-efad7974b681 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:16.702324 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-28f86eba-281d-4f6f-9997-efad7974b681 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:16.708500 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28f86eba-281d-4f6f-9997-efad7974b681 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:16.708948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28f86eba-281d-4f6f-9997-efad7974b681 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:16.709749 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28f86eba-281d-4f6f-9997-efad7974b681 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:16.710188 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-28f86eba-281d-4f6f-9997-efad7974b681 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:16.902186 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-28f86eba-281d-4f6f-9997-efad7974b681 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:16.910060 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-28f86eba-281d-4f6f-9997-efad7974b681 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.213660 May 17 12:11:16.910637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 247/507] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:16 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:17.332501 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-94949cf9-8f0f-49df-9b8f-a72a3d6e6867 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:17.333114 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-94949cf9-8f0f-49df-9b8f-a72a3d6e6867 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:17.339405 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-94949cf9-8f0f-49df-9b8f-a72a3d6e6867 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:17.339857 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-94949cf9-8f0f-49df-9b8f-a72a3d6e6867 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:17.340654 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-94949cf9-8f0f-49df-9b8f-a72a3d6e6867 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:17.341099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-94949cf9-8f0f-49df-9b8f-a72a3d6e6867 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:17.468372 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-94949cf9-8f0f-49df-9b8f-a72a3d6e6867 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:17.477288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-94949cf9-8f0f-49df-9b8f-a72a3d6e6867 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:17.478995 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-94949cf9-8f0f-49df-9b8f-a72a3d6e6867 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:17.479971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-94949cf9-8f0f-49df-9b8f-a72a3d6e6867 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.151393 May 17 12:11:17.480573 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 261/508] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:17 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:17.927312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-adf8f7e5-eac5-4baf-b2f3-59b7012a6564 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:17.927970 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-adf8f7e5-eac5-4baf-b2f3-59b7012a6564 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:17.934505 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-adf8f7e5-eac5-4baf-b2f3-59b7012a6564 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:17.935633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-adf8f7e5-eac5-4baf-b2f3-59b7012a6564 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:17.936606 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-adf8f7e5-eac5-4baf-b2f3-59b7012a6564 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:17.937123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-adf8f7e5-eac5-4baf-b2f3-59b7012a6564 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:18.083628 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-adf8f7e5-eac5-4baf-b2f3-59b7012a6564 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:18.093053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-adf8f7e5-eac5-4baf-b2f3-59b7012a6564 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.169701 May 17 12:11:18.093717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 248/509] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:17 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:18.499006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-91c126ca-f0bd-4cda-85d1-106f1b3f3d35 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:18.499713 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-91c126ca-f0bd-4cda-85d1-106f1b3f3d35 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:18.506472 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-91c126ca-f0bd-4cda-85d1-106f1b3f3d35 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:18.506929 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-91c126ca-f0bd-4cda-85d1-106f1b3f3d35 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:18.507720 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-91c126ca-f0bd-4cda-85d1-106f1b3f3d35 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:18.508159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-91c126ca-f0bd-4cda-85d1-106f1b3f3d35 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:18.645484 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-91c126ca-f0bd-4cda-85d1-106f1b3f3d35 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:18.654318 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-91c126ca-f0bd-4cda-85d1-106f1b3f3d35 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:18.655836 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-91c126ca-f0bd-4cda-85d1-106f1b3f3d35 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:18.657027 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-91c126ca-f0bd-4cda-85d1-106f1b3f3d35 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.162086 May 17 12:11:18.657596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 262/510] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:18 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:19.109373 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-be998600-d13c-46e9-9c32-0ff294030c03 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:19.109993 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-be998600-d13c-46e9-9c32-0ff294030c03 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:19.116333 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-be998600-d13c-46e9-9c32-0ff294030c03 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:19.116784 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-be998600-d13c-46e9-9c32-0ff294030c03 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:19.117549 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-be998600-d13c-46e9-9c32-0ff294030c03 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:19.117988 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-be998600-d13c-46e9-9c32-0ff294030c03 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:19.479747 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-be998600-d13c-46e9-9c32-0ff294030c03 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:19.487750 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-be998600-d13c-46e9-9c32-0ff294030c03 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.382368 May 17 12:11:19.488346 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 249/511] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:19 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:11:19.675260 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-54eff78e-2911-414f-b742-c7c60976cca6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:19.675913 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-54eff78e-2911-414f-b742-c7c60976cca6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:19.683203 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-54eff78e-2911-414f-b742-c7c60976cca6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:19.683653 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-54eff78e-2911-414f-b742-c7c60976cca6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:19.684460 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-54eff78e-2911-414f-b742-c7c60976cca6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:19.684945 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-54eff78e-2911-414f-b742-c7c60976cca6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:19.868545 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-54eff78e-2911-414f-b742-c7c60976cca6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:19.877471 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-54eff78e-2911-414f-b742-c7c60976cca6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:19.878971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-54eff78e-2911-414f-b742-c7c60976cca6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:19.880128 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-54eff78e-2911-414f-b742-c7c60976cca6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.209101 May 17 12:11:19.880735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 263/512] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:19 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:20.505329 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b01e1c96-9bd9-4d18-b9c5-fc734d884451 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:20.505955 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b01e1c96-9bd9-4d18-b9c5-fc734d884451 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:20.512397 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b01e1c96-9bd9-4d18-b9c5-fc734d884451 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:20.512852 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b01e1c96-9bd9-4d18-b9c5-fc734d884451 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:20.514442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b01e1c96-9bd9-4d18-b9c5-fc734d884451 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:20.514891 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b01e1c96-9bd9-4d18-b9c5-fc734d884451 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:20.640141 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b01e1c96-9bd9-4d18-b9c5-fc734d884451 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:20.647910 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b01e1c96-9bd9-4d18-b9c5-fc734d884451 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.146649 May 17 12:11:20.648517 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 250/513] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:20 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:11:20.898867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-efea668a-5dc9-4981-a463-14ce768a2217 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:20.899455 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-efea668a-5dc9-4981-a463-14ce768a2217 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:20.906528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-efea668a-5dc9-4981-a463-14ce768a2217 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:20.906929 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-efea668a-5dc9-4981-a463-14ce768a2217 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:20.907704 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-efea668a-5dc9-4981-a463-14ce768a2217 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:20.908136 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-efea668a-5dc9-4981-a463-14ce768a2217 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:21.047184 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-efea668a-5dc9-4981-a463-14ce768a2217 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:21.056164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-efea668a-5dc9-4981-a463-14ce768a2217 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:21.057758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-efea668a-5dc9-4981-a463-14ce768a2217 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:21.058920 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-efea668a-5dc9-4981-a463-14ce768a2217 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.163973 May 17 12:11:21.059505 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 264/514] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:20 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:21.664944 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8556f99b-4a97-4dc3-9130-12c37af928d2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:21.666290 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8556f99b-4a97-4dc3-9130-12c37af928d2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:21.674483 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8556f99b-4a97-4dc3-9130-12c37af928d2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:21.674978 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8556f99b-4a97-4dc3-9130-12c37af928d2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:21.675999 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8556f99b-4a97-4dc3-9130-12c37af928d2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:21.676697 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8556f99b-4a97-4dc3-9130-12c37af928d2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:21.814865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8556f99b-4a97-4dc3-9130-12c37af928d2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:21.822943 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8556f99b-4a97-4dc3-9130-12c37af928d2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.161943 May 17 12:11:21.823791 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 251/515] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:21 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:22.078633 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2ccf1846-2433-402c-bec7-7caaf3fa4f45 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:22.079259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2ccf1846-2433-402c-bec7-7caaf3fa4f45 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:22.091000 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2ccf1846-2433-402c-bec7-7caaf3fa4f45 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:22.091000 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2ccf1846-2433-402c-bec7-7caaf3fa4f45 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:22.091000 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2ccf1846-2433-402c-bec7-7caaf3fa4f45 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:22.091000 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2ccf1846-2433-402c-bec7-7caaf3fa4f45 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:22.241995 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2ccf1846-2433-402c-bec7-7caaf3fa4f45 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:22.250775 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2ccf1846-2433-402c-bec7-7caaf3fa4f45 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:22.252287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2ccf1846-2433-402c-bec7-7caaf3fa4f45 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:22.253447 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2ccf1846-2433-402c-bec7-7caaf3fa4f45 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.179452 May 17 12:11:22.254012 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 265/516] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:22 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:22.842791 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-197395e0-8834-4bf3-9680-992837510bbb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:22.843837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-197395e0-8834-4bf3-9680-992837510bbb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:22.850065 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-197395e0-8834-4bf3-9680-992837510bbb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:22.850514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-197395e0-8834-4bf3-9680-992837510bbb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:22.851295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-197395e0-8834-4bf3-9680-992837510bbb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:22.851745 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-197395e0-8834-4bf3-9680-992837510bbb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:22.982700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-197395e0-8834-4bf3-9680-992837510bbb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:22.992306 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-197395e0-8834-4bf3-9680-992837510bbb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.153838 May 17 12:11:22.992893 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 252/517] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:22 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:23.271706 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c3a08416-1602-44cf-bc8a-819d22b59cc9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:23.272427 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c3a08416-1602-44cf-bc8a-819d22b59cc9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:23.279486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3a08416-1602-44cf-bc8a-819d22b59cc9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:23.279916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3a08416-1602-44cf-bc8a-819d22b59cc9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:23.280722 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3a08416-1602-44cf-bc8a-819d22b59cc9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:23.281156 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c3a08416-1602-44cf-bc8a-819d22b59cc9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:23.424902 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c3a08416-1602-44cf-bc8a-819d22b59cc9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:23.433241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c3a08416-1602-44cf-bc8a-819d22b59cc9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:23.434675 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c3a08416-1602-44cf-bc8a-819d22b59cc9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:23.435817 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c3a08416-1602-44cf-bc8a-819d22b59cc9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.167911 May 17 12:11:23.436420 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 266/518] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:23 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:24.011471 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-512028bb-45a9-439d-a88e-63f863beb464 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:24.013048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-512028bb-45a9-439d-a88e-63f863beb464 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:24.029076 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-512028bb-45a9-439d-a88e-63f863beb464 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:24.029076 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-512028bb-45a9-439d-a88e-63f863beb464 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:24.029839 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-512028bb-45a9-439d-a88e-63f863beb464 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:24.030292 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-512028bb-45a9-439d-a88e-63f863beb464 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:24.219410 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-512028bb-45a9-439d-a88e-63f863beb464 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:24.228628 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-512028bb-45a9-439d-a88e-63f863beb464 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.221913 May 17 12:11:24.229414 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 253/519] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:24 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:11:24.455847 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-193f7d5e-92cf-4af4-88d5-6d57f523ff10 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:24.456607 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-193f7d5e-92cf-4af4-88d5-6d57f523ff10 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:24.463069 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-193f7d5e-92cf-4af4-88d5-6d57f523ff10 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:24.463584 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-193f7d5e-92cf-4af4-88d5-6d57f523ff10 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:24.464483 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-193f7d5e-92cf-4af4-88d5-6d57f523ff10 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:24.465096 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-193f7d5e-92cf-4af4-88d5-6d57f523ff10 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:24.639959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-193f7d5e-92cf-4af4-88d5-6d57f523ff10 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:24.648266 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-193f7d5e-92cf-4af4-88d5-6d57f523ff10 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:24.649779 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-193f7d5e-92cf-4af4-88d5-6d57f523ff10 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:24.650935 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-193f7d5e-92cf-4af4-88d5-6d57f523ff10 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.199497 May 17 12:11:24.651496 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 267/520] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:24 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:25.246284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-24c37000-aaec-4ef2-a3d8-a8c100a6e04d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:25.246882 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-24c37000-aaec-4ef2-a3d8-a8c100a6e04d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:25.253361 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-24c37000-aaec-4ef2-a3d8-a8c100a6e04d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:25.253807 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-24c37000-aaec-4ef2-a3d8-a8c100a6e04d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:25.254594 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-24c37000-aaec-4ef2-a3d8-a8c100a6e04d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:25.255023 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-24c37000-aaec-4ef2-a3d8-a8c100a6e04d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:25.389694 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-24c37000-aaec-4ef2-a3d8-a8c100a6e04d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:25.400007 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-24c37000-aaec-4ef2-a3d8-a8c100a6e04d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.157452 May 17 12:11:25.400632 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 254/521] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:25 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:25.669264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e6c6a73e-0bcc-4b03-8532-feb685c02bc6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:25.669877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e6c6a73e-0bcc-4b03-8532-feb685c02bc6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:25.676089 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e6c6a73e-0bcc-4b03-8532-feb685c02bc6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:25.676565 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e6c6a73e-0bcc-4b03-8532-feb685c02bc6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:25.677327 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e6c6a73e-0bcc-4b03-8532-feb685c02bc6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:25.677756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e6c6a73e-0bcc-4b03-8532-feb685c02bc6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:25.803903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e6c6a73e-0bcc-4b03-8532-feb685c02bc6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:25.812067 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e6c6a73e-0bcc-4b03-8532-feb685c02bc6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:25.814078 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e6c6a73e-0bcc-4b03-8532-feb685c02bc6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:25.815225 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e6c6a73e-0bcc-4b03-8532-feb685c02bc6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.149903 May 17 12:11:25.815785 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 268/522] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:25 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:11:26.417328 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b447d181-005a-463c-bf29-dc454d72a431 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:26.417943 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b447d181-005a-463c-bf29-dc454d72a431 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:26.424313 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b447d181-005a-463c-bf29-dc454d72a431 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:26.424766 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b447d181-005a-463c-bf29-dc454d72a431 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:26.425528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b447d181-005a-463c-bf29-dc454d72a431 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:26.425966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b447d181-005a-463c-bf29-dc454d72a431 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:26.553372 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b447d181-005a-463c-bf29-dc454d72a431 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:26.561183 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b447d181-005a-463c-bf29-dc454d72a431 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.147659 May 17 12:11:26.561748 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 255/523] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:26 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:26.834373 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-47eb2ff9-75fe-4f10-8f23-60eb3d91b15c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:26.835045 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-47eb2ff9-75fe-4f10-8f23-60eb3d91b15c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:26.841384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-47eb2ff9-75fe-4f10-8f23-60eb3d91b15c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:26.841832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-47eb2ff9-75fe-4f10-8f23-60eb3d91b15c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:26.842596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-47eb2ff9-75fe-4f10-8f23-60eb3d91b15c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:26.843031 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-47eb2ff9-75fe-4f10-8f23-60eb3d91b15c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:26.973544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-47eb2ff9-75fe-4f10-8f23-60eb3d91b15c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:26.981782 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-47eb2ff9-75fe-4f10-8f23-60eb3d91b15c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:26.983306 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-47eb2ff9-75fe-4f10-8f23-60eb3d91b15c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:26.984516 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-47eb2ff9-75fe-4f10-8f23-60eb3d91b15c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.153958 May 17 12:11:26.985077 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 269/524] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:26 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:27.578591 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-cf098871-7f72-4944-8382-59de3b5ba1f1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:27.579826 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-cf098871-7f72-4944-8382-59de3b5ba1f1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:27.586342 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cf098871-7f72-4944-8382-59de3b5ba1f1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:27.586802 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cf098871-7f72-4944-8382-59de3b5ba1f1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:27.587546 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cf098871-7f72-4944-8382-59de3b5ba1f1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:27.587978 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cf098871-7f72-4944-8382-59de3b5ba1f1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:27.715476 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-cf098871-7f72-4944-8382-59de3b5ba1f1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:27.723818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-cf098871-7f72-4944-8382-59de3b5ba1f1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1720 microversion: 2.1 time: 0.149009 May 17 12:11:27.724404 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 256/525] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:27 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:28.003274 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e3d5d50c-fb5d-491b-a0d2-83ae3d48aa2c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:28.003877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e3d5d50c-fb5d-491b-a0d2-83ae3d48aa2c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:28.010222 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e3d5d50c-fb5d-491b-a0d2-83ae3d48aa2c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:28.010670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e3d5d50c-fb5d-491b-a0d2-83ae3d48aa2c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:28.011444 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e3d5d50c-fb5d-491b-a0d2-83ae3d48aa2c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:28.011920 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e3d5d50c-fb5d-491b-a0d2-83ae3d48aa2c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:28.166967 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e3d5d50c-fb5d-491b-a0d2-83ae3d48aa2c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:28.175347 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e3d5d50c-fb5d-491b-a0d2-83ae3d48aa2c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:28.176912 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e3d5d50c-fb5d-491b-a0d2-83ae3d48aa2c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:28.178076 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e3d5d50c-fb5d-491b-a0d2-83ae3d48aa2c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.179175 May 17 12:11:28.178757 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 270/526] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:27 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:28.741218 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b0d1fe4d-79de-4f25-b4f7-47d8a82be291 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:28.741831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b0d1fe4d-79de-4f25-b4f7-47d8a82be291 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:28.748136 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0d1fe4d-79de-4f25-b4f7-47d8a82be291 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:28.748618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0d1fe4d-79de-4f25-b4f7-47d8a82be291 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:28.749384 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0d1fe4d-79de-4f25-b4f7-47d8a82be291 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:28.749822 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0d1fe4d-79de-4f25-b4f7-47d8a82be291 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:28.879547 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b0d1fe4d-79de-4f25-b4f7-47d8a82be291 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:28.887267 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b0d1fe4d-79de-4f25-b4f7-47d8a82be291 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1697 microversion: 2.1 time: 0.149901 May 17 12:11:28.887846 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 257/527] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:28 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1697 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:28.903487 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-148bcb06-3f0b-4bf0-b9dd-8409fe1dc248 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:11:28.910094 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-148bcb06-3f0b-4bf0-b9dd-8409fe1dc248 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:28.910638 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-148bcb06-3f0b-4bf0-b9dd-8409fe1dc248 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:28.933026 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-148bcb06-3f0b-4bf0-b9dd-8409fe1dc248 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Going to try to start instance {{(pid=117114) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 12:11:28.977703 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-148bcb06-3f0b-4bf0-b9dd-8409fe1dc248 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/action" status: 202 len: 0 microversion: 2.1 time: 0.077908 May 17 12:11:28.978303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 271/528] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:11:28 2022] POST /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:11:28.990218 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d0db4814-f9ca-4984-b428-9a68d5736003 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:28.990912 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d0db4814-f9ca-4984-b428-9a68d5736003 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:28.997198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0db4814-f9ca-4984-b428-9a68d5736003 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:28.997725 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0db4814-f9ca-4984-b428-9a68d5736003 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:28.998502 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0db4814-f9ca-4984-b428-9a68d5736003 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:28.998938 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0db4814-f9ca-4984-b428-9a68d5736003 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:29.144343 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d0db4814-f9ca-4984-b428-9a68d5736003 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:29.146137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d0db4814-f9ca-4984-b428-9a68d5736003 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1706 microversion: 2.1 time: 0.163397 May 17 12:11:29.146710 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 258/529] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:28 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1706 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:29.197903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c48aa070-5a06-4326-aa67-883956def426 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:29.198698 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c48aa070-5a06-4326-aa67-883956def426 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:29.204939 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c48aa070-5a06-4326-aa67-883956def426 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:29.205391 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c48aa070-5a06-4326-aa67-883956def426 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:29.206161 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c48aa070-5a06-4326-aa67-883956def426 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:29.206596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c48aa070-5a06-4326-aa67-883956def426 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:29.333449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c48aa070-5a06-4326-aa67-883956def426 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:29.341688 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c48aa070-5a06-4326-aa67-883956def426 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:29.343195 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c48aa070-5a06-4326-aa67-883956def426 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:29.344512 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c48aa070-5a06-4326-aa67-883956def426 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.151389 May 17 12:11:29.345834 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 272/530] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:29 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:30.163106 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5954eb87-625a-40b3-bc1a-d48cc79ff879 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:30.163755 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5954eb87-625a-40b3-bc1a-d48cc79ff879 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:30.171289 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5954eb87-625a-40b3-bc1a-d48cc79ff879 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:30.171751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5954eb87-625a-40b3-bc1a-d48cc79ff879 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:30.172564 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5954eb87-625a-40b3-bc1a-d48cc79ff879 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:30.174233 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5954eb87-625a-40b3-bc1a-d48cc79ff879 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:30.316427 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5954eb87-625a-40b3-bc1a-d48cc79ff879 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:30.324462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5954eb87-625a-40b3-bc1a-d48cc79ff879 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1706 microversion: 2.1 time: 0.165150 May 17 12:11:30.325040 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 259/531] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:30 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1706 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:30.471330 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-746bda96-b51f-4d62-8f5e-7442c08bb04b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:30.471970 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-746bda96-b51f-4d62-8f5e-7442c08bb04b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:30.477867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-746bda96-b51f-4d62-8f5e-7442c08bb04b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:30.478319 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-746bda96-b51f-4d62-8f5e-7442c08bb04b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:30.479084 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-746bda96-b51f-4d62-8f5e-7442c08bb04b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:30.479520 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-746bda96-b51f-4d62-8f5e-7442c08bb04b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:30.610704 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-746bda96-b51f-4d62-8f5e-7442c08bb04b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:30.619264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-746bda96-b51f-4d62-8f5e-7442c08bb04b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:30.620808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-746bda96-b51f-4d62-8f5e-7442c08bb04b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:30.621964 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-746bda96-b51f-4d62-8f5e-7442c08bb04b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.262503 May 17 12:11:30.622531 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 273/532] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:30 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:31.343254 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2cc3a617-e885-4e33-bd2f-989bae73992c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:31.344090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2cc3a617-e885-4e33-bd2f-989bae73992c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:31.351275 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2cc3a617-e885-4e33-bd2f-989bae73992c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:31.351840 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2cc3a617-e885-4e33-bd2f-989bae73992c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:31.352535 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2cc3a617-e885-4e33-bd2f-989bae73992c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:31.352996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2cc3a617-e885-4e33-bd2f-989bae73992c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:31.557030 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2cc3a617-e885-4e33-bd2f-989bae73992c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:31.566497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2cc3a617-e885-4e33-bd2f-989bae73992c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1706 microversion: 2.1 time: 0.227582 May 17 12:11:31.567433 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 260/533] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:31 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1706 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:31.639720 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f2087301-2c04-4dea-9355-849cd33bc907 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:31.640455 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f2087301-2c04-4dea-9355-849cd33bc907 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:31.647346 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2087301-2c04-4dea-9355-849cd33bc907 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:31.647883 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2087301-2c04-4dea-9355-849cd33bc907 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:31.648695 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2087301-2c04-4dea-9355-849cd33bc907 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:31.649135 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2087301-2c04-4dea-9355-849cd33bc907 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:31.781883 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f2087301-2c04-4dea-9355-849cd33bc907 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:31.790408 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f2087301-2c04-4dea-9355-849cd33bc907 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:31.792159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f2087301-2c04-4dea-9355-849cd33bc907 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:31.794256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f2087301-2c04-4dea-9355-849cd33bc907 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.158186 May 17 12:11:31.795274 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 274/534] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:31 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:32.583757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4066b0e7-ef2e-4447-b809-1be7e985ec69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:32.584401 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4066b0e7-ef2e-4447-b809-1be7e985ec69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:32.590556 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4066b0e7-ef2e-4447-b809-1be7e985ec69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:32.591008 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4066b0e7-ef2e-4447-b809-1be7e985ec69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:32.591770 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4066b0e7-ef2e-4447-b809-1be7e985ec69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:32.592225 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4066b0e7-ef2e-4447-b809-1be7e985ec69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:32.731687 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4066b0e7-ef2e-4447-b809-1be7e985ec69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:32.740012 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4066b0e7-ef2e-4447-b809-1be7e985ec69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1710 microversion: 2.1 time: 0.159973 May 17 12:11:32.743126 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 261/535] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:32 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:32.812782 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-481a1845-d5a0-4719-9c0d-176f32fd0919 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:32.814050 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-481a1845-d5a0-4719-9c0d-176f32fd0919 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:32.820383 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-481a1845-d5a0-4719-9c0d-176f32fd0919 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:32.820832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-481a1845-d5a0-4719-9c0d-176f32fd0919 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:32.821597 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-481a1845-d5a0-4719-9c0d-176f32fd0919 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:32.822279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-481a1845-d5a0-4719-9c0d-176f32fd0919 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:32.954219 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-481a1845-d5a0-4719-9c0d-176f32fd0919 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:32.962462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-481a1845-d5a0-4719-9c0d-176f32fd0919 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:32.963967 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-481a1845-d5a0-4719-9c0d-176f32fd0919 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:32.965151 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-481a1845-d5a0-4719-9c0d-176f32fd0919 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.156192 May 17 12:11:32.965720 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 275/536] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:32 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:33.983046 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d1e5ffb2-fe53-4b1c-8c0b-6737ec25e1b3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:33.983664 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d1e5ffb2-fe53-4b1c-8c0b-6737ec25e1b3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:33.990166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1e5ffb2-fe53-4b1c-8c0b-6737ec25e1b3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:33.990648 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1e5ffb2-fe53-4b1c-8c0b-6737ec25e1b3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:33.991420 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1e5ffb2-fe53-4b1c-8c0b-6737ec25e1b3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:33.991860 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1e5ffb2-fe53-4b1c-8c0b-6737ec25e1b3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:34.120038 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d1e5ffb2-fe53-4b1c-8c0b-6737ec25e1b3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:34.128906 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d1e5ffb2-fe53-4b1c-8c0b-6737ec25e1b3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:34.130405 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d1e5ffb2-fe53-4b1c-8c0b-6737ec25e1b3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:34.131563 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d1e5ffb2-fe53-4b1c-8c0b-6737ec25e1b3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.152404 May 17 12:11:34.132130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 262/537] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:33 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:35.150455 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ce1aa186-c71f-4951-b00a-1827c0eabe46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:35.151075 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ce1aa186-c71f-4951-b00a-1827c0eabe46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:35.158188 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce1aa186-c71f-4951-b00a-1827c0eabe46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:35.158732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce1aa186-c71f-4951-b00a-1827c0eabe46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:35.159514 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce1aa186-c71f-4951-b00a-1827c0eabe46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:35.159956 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce1aa186-c71f-4951-b00a-1827c0eabe46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:35.293650 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ce1aa186-c71f-4951-b00a-1827c0eabe46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:35.301918 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ce1aa186-c71f-4951-b00a-1827c0eabe46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:35.303425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ce1aa186-c71f-4951-b00a-1827c0eabe46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:35.304610 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ce1aa186-c71f-4951-b00a-1827c0eabe46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.158057 May 17 12:11:35.305220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 276/538] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:35 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:36.323166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f21d0caa-698c-47ac-9d8a-418fb8bf9916 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:36.323773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f21d0caa-698c-47ac-9d8a-418fb8bf9916 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:36.329977 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f21d0caa-698c-47ac-9d8a-418fb8bf9916 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:36.330432 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f21d0caa-698c-47ac-9d8a-418fb8bf9916 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:36.331190 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f21d0caa-698c-47ac-9d8a-418fb8bf9916 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:36.331621 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f21d0caa-698c-47ac-9d8a-418fb8bf9916 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:36.456943 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f21d0caa-698c-47ac-9d8a-418fb8bf9916 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:36.465370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f21d0caa-698c-47ac-9d8a-418fb8bf9916 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:36.466877 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f21d0caa-698c-47ac-9d8a-418fb8bf9916 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:36.468036 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f21d0caa-698c-47ac-9d8a-418fb8bf9916 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.149090 May 17 12:11:36.468643 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 263/539] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:36 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:37.487896 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9be9a715-11a3-4f70-a834-72225e36dc20 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:37.488553 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9be9a715-11a3-4f70-a834-72225e36dc20 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:37.494846 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9be9a715-11a3-4f70-a834-72225e36dc20 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:37.495291 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9be9a715-11a3-4f70-a834-72225e36dc20 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:37.496048 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9be9a715-11a3-4f70-a834-72225e36dc20 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:37.496511 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9be9a715-11a3-4f70-a834-72225e36dc20 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:37.627613 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9be9a715-11a3-4f70-a834-72225e36dc20 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:37.635715 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9be9a715-11a3-4f70-a834-72225e36dc20 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:37.637230 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9be9a715-11a3-4f70-a834-72225e36dc20 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:37.638376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9be9a715-11a3-4f70-a834-72225e36dc20 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.155144 May 17 12:11:37.638931 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 277/540] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:37 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:38.656643 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ca40405d-a11d-40cf-853b-6af04c07f768 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:38.657771 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ca40405d-a11d-40cf-853b-6af04c07f768 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:38.664132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca40405d-a11d-40cf-853b-6af04c07f768 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:38.664612 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca40405d-a11d-40cf-853b-6af04c07f768 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:38.665405 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca40405d-a11d-40cf-853b-6af04c07f768 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:38.665840 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca40405d-a11d-40cf-853b-6af04c07f768 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:38.793142 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ca40405d-a11d-40cf-853b-6af04c07f768 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:38.802033 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ca40405d-a11d-40cf-853b-6af04c07f768 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:38.803562 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ca40405d-a11d-40cf-853b-6af04c07f768 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:38.804791 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ca40405d-a11d-40cf-853b-6af04c07f768 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.152081 May 17 12:11:38.805358 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 264/541] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:38 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:39.822916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3d7e4ad1-57b4-4b6d-9d92-27209880323e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:39.823521 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3d7e4ad1-57b4-4b6d-9d92-27209880323e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:39.829895 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3d7e4ad1-57b4-4b6d-9d92-27209880323e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:39.830337 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3d7e4ad1-57b4-4b6d-9d92-27209880323e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:39.831101 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3d7e4ad1-57b4-4b6d-9d92-27209880323e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:39.831535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3d7e4ad1-57b4-4b6d-9d92-27209880323e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:39.956979 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3d7e4ad1-57b4-4b6d-9d92-27209880323e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:39.965074 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3d7e4ad1-57b4-4b6d-9d92-27209880323e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:39.966572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3d7e4ad1-57b4-4b6d-9d92-27209880323e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:39.967721 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3d7e4ad1-57b4-4b6d-9d92-27209880323e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.148901 May 17 12:11:39.968335 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 278/542] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:39 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:40.986267 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-89d530ef-6147-48b0-9d56-3cb4360278ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:40.986979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-89d530ef-6147-48b0-9d56-3cb4360278ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:40.993514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-89d530ef-6147-48b0-9d56-3cb4360278ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:40.993976 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-89d530ef-6147-48b0-9d56-3cb4360278ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:40.994757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-89d530ef-6147-48b0-9d56-3cb4360278ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:40.995340 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-89d530ef-6147-48b0-9d56-3cb4360278ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:41.121763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-89d530ef-6147-48b0-9d56-3cb4360278ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:41.130629 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-89d530ef-6147-48b0-9d56-3cb4360278ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:41.132151 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-89d530ef-6147-48b0-9d56-3cb4360278ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:41.133348 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-89d530ef-6147-48b0-9d56-3cb4360278ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.151395 May 17 12:11:41.133914 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 265/543] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:40 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:42.151514 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ae37a589-1685-4bf7-95cd-ba76a42c95e9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:42.152360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ae37a589-1685-4bf7-95cd-ba76a42c95e9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:42.158994 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ae37a589-1685-4bf7-95cd-ba76a42c95e9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:42.159673 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ae37a589-1685-4bf7-95cd-ba76a42c95e9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:42.160477 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ae37a589-1685-4bf7-95cd-ba76a42c95e9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:42.160918 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ae37a589-1685-4bf7-95cd-ba76a42c95e9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:42.293932 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ae37a589-1685-4bf7-95cd-ba76a42c95e9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:42.302638 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ae37a589-1685-4bf7-95cd-ba76a42c95e9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:42.304130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ae37a589-1685-4bf7-95cd-ba76a42c95e9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:42.305313 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ae37a589-1685-4bf7-95cd-ba76a42c95e9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.158121 May 17 12:11:42.305871 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 279/544] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:42 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:42.768574 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-90719923-6597-4d82-91bc-38bc959464b7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df795007-e2ba-4c1e-a565-f2d28d4c7182"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:11:42.769704 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-90719923-6597-4d82-91bc-38bc959464b7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:42.776695 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-90719923-6597-4d82-91bc-38bc959464b7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:42.777156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-90719923-6597-4d82-91bc-38bc959464b7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:42.777938 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-90719923-6597-4d82-91bc-38bc959464b7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:42.778398 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-90719923-6597-4d82-91bc-38bc959464b7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:43.212676 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-90719923-6597-4d82-91bc-38bc959464b7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448606 May 17 12:11:43.213324 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 266/545] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:11:42 2022] POST /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:11:43.323140 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e53b814a-a228-4010-bb8d-a8f02a986ce2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:43.323752 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e53b814a-a228-4010-bb8d-a8f02a986ce2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:43.330662 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e53b814a-a228-4010-bb8d-a8f02a986ce2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:43.331115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e53b814a-a228-4010-bb8d-a8f02a986ce2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:43.331888 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e53b814a-a228-4010-bb8d-a8f02a986ce2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:43.332370 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e53b814a-a228-4010-bb8d-a8f02a986ce2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:43.461791 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e53b814a-a228-4010-bb8d-a8f02a986ce2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:43.470770 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e53b814a-a228-4010-bb8d-a8f02a986ce2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:43.472427 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e53b814a-a228-4010-bb8d-a8f02a986ce2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:43.473582 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e53b814a-a228-4010-bb8d-a8f02a986ce2 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.154746 May 17 12:11:43.474144 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 280/546] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:43 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:43.524003 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-db33e819-d406-4a48-903d-f6cac852be3a req-812cced6-9f47-467d-81ba-f878bb1bb8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d883f923-082e-4ee1-ba3e-0975ba2d7409", "name": "network-vif-plugged", "status": "completed", "tag": "cf6ad775-daff-4e4a-b3ee-b4652d53fdfe"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:11:43.534229 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-db33e819-d406-4a48-903d-f6cac852be3a req-812cced6-9f47-467d-81ba-f878bb1bb8ee service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:43.534684 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-db33e819-d406-4a48-903d-f6cac852be3a req-812cced6-9f47-467d-81ba-f878bb1bb8ee service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:43.546077 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-db33e819-d406-4a48-903d-f6cac852be3a req-812cced6-9f47-467d-81ba-f878bb1bb8ee service nova] Creating event network-vif-plugged:cf6ad775-daff-4e4a-b3ee-b4652d53fdfe for instance d883f923-082e-4ee1-ba3e-0975ba2d7409 on hv-cinder-83769 May 17 12:11:43.550809 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-db33e819-d406-4a48-903d-f6cac852be3a req-812cced6-9f47-467d-81ba-f878bb1bb8ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030851 May 17 12:11:43.551580 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 267/547] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:11:44.491605 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f85e997f-86db-4f4f-bbd4-d03ef846df2d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:44.492235 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f85e997f-86db-4f4f-bbd4-d03ef846df2d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:44.498509 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f85e997f-86db-4f4f-bbd4-d03ef846df2d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:44.498961 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f85e997f-86db-4f4f-bbd4-d03ef846df2d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:44.499731 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f85e997f-86db-4f4f-bbd4-d03ef846df2d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:44.500169 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f85e997f-86db-4f4f-bbd4-d03ef846df2d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:44.834320 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f85e997f-86db-4f4f-bbd4-d03ef846df2d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:44.842735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f85e997f-86db-4f4f-bbd4-d03ef846df2d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:44.844279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f85e997f-86db-4f4f-bbd4-d03ef846df2d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:44.846033 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f85e997f-86db-4f4f-bbd4-d03ef846df2d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.358369 May 17 12:11:44.846595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 281/548] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:44 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:45.865960 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-25897075-0b94-4295-91f9-dde9f7842937 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:45.866665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-25897075-0b94-4295-91f9-dde9f7842937 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:45.872731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-25897075-0b94-4295-91f9-dde9f7842937 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:45.873181 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-25897075-0b94-4295-91f9-dde9f7842937 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:45.873940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-25897075-0b94-4295-91f9-dde9f7842937 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:45.874376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-25897075-0b94-4295-91f9-dde9f7842937 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:46.002038 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-25897075-0b94-4295-91f9-dde9f7842937 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:46.010232 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-25897075-0b94-4295-91f9-dde9f7842937 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:46.011741 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-25897075-0b94-4295-91f9-dde9f7842937 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:46.012925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-25897075-0b94-4295-91f9-dde9f7842937 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1808 microversion: 2.20 time: 0.151819 May 17 12:11:46.013483 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 268/549] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:45 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:47.030833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ac21b9fc-0829-471e-97c5-44503b30dfd6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:47.031380 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ac21b9fc-0829-471e-97c5-44503b30dfd6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:47.037732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ac21b9fc-0829-471e-97c5-44503b30dfd6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:47.038175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ac21b9fc-0829-471e-97c5-44503b30dfd6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:47.038937 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ac21b9fc-0829-471e-97c5-44503b30dfd6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:47.039368 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ac21b9fc-0829-471e-97c5-44503b30dfd6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:47.169124 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ac21b9fc-0829-471e-97c5-44503b30dfd6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:47.177694 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ac21b9fc-0829-471e-97c5-44503b30dfd6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:47.179198 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ac21b9fc-0829-471e-97c5-44503b30dfd6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:47.180383 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ac21b9fc-0829-471e-97c5-44503b30dfd6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1795 microversion: 2.20 time: 0.153448 May 17 12:11:47.180945 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 282/550] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:11:47 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1795 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:11:50.686484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ecc3b758-3770-4373-8b63-53fd25dd687d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:11:50.687431 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ecc3b758-3770-4373-8b63-53fd25dd687d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:50.694300 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ecc3b758-3770-4373-8b63-53fd25dd687d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:50.694687 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ecc3b758-3770-4373-8b63-53fd25dd687d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:50.695463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ecc3b758-3770-4373-8b63-53fd25dd687d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:50.695905 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ecc3b758-3770-4373-8b63-53fd25dd687d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:50.718302 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-ecc3b758-3770-4373-8b63-53fd25dd687d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lazy-loading 'flavor' on Instance uuid ce70576a-62fb-4bcc-9163-cfc28131518a {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:11:50.835917 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ecc3b758-3770-4373-8b63-53fd25dd687d tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/action" status: 200 len: 32 microversion: 2.1 time: 0.153313 May 17 12:11:50.836800 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 269/551] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:11:50 2022] POST /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 12:11:50.845784 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5006e0f1-39f8-4836-8f07-300302fd4b0e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:50.846396 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5006e0f1-39f8-4836-8f07-300302fd4b0e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:50.852654 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5006e0f1-39f8-4836-8f07-300302fd4b0e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:50.853104 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5006e0f1-39f8-4836-8f07-300302fd4b0e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:50.853874 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5006e0f1-39f8-4836-8f07-300302fd4b0e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:50.854383 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5006e0f1-39f8-4836-8f07-300302fd4b0e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:50.990355 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5006e0f1-39f8-4836-8f07-300302fd4b0e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:50.999373 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5006e0f1-39f8-4836-8f07-300302fd4b0e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.157275 May 17 12:11:51.000589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 283/552] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:50 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:52.018999 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2655a127-2dae-47b7-8154-ebe0e40356bf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:52.019688 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2655a127-2dae-47b7-8154-ebe0e40356bf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:52.025809 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2655a127-2dae-47b7-8154-ebe0e40356bf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:52.026258 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2655a127-2dae-47b7-8154-ebe0e40356bf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:52.027019 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2655a127-2dae-47b7-8154-ebe0e40356bf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:52.027449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2655a127-2dae-47b7-8154-ebe0e40356bf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:52.163246 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2655a127-2dae-47b7-8154-ebe0e40356bf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:52.171624 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2655a127-2dae-47b7-8154-ebe0e40356bf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.157483 May 17 12:11:52.172275 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 270/553] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:52 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:53.190291 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7ca7ac81-e437-42c4-bf25-de2273b17108 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:53.190927 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7ca7ac81-e437-42c4-bf25-de2273b17108 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:53.197554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7ca7ac81-e437-42c4-bf25-de2273b17108 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:53.198024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7ca7ac81-e437-42c4-bf25-de2273b17108 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:53.198781 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7ca7ac81-e437-42c4-bf25-de2273b17108 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:53.199213 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7ca7ac81-e437-42c4-bf25-de2273b17108 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:53.323059 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7ca7ac81-e437-42c4-bf25-de2273b17108 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:53.331175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7ca7ac81-e437-42c4-bf25-de2273b17108 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.145437 May 17 12:11:53.331738 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 284/554] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:53 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:54.348035 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4aed4f4b-809a-4984-a854-8f542044b4a6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:54.348671 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4aed4f4b-809a-4984-a854-8f542044b4a6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:54.355020 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4aed4f4b-809a-4984-a854-8f542044b4a6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:54.355466 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4aed4f4b-809a-4984-a854-8f542044b4a6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:54.356262 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4aed4f4b-809a-4984-a854-8f542044b4a6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:54.356703 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4aed4f4b-809a-4984-a854-8f542044b4a6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:54.487034 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4aed4f4b-809a-4984-a854-8f542044b4a6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:54.494720 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4aed4f4b-809a-4984-a854-8f542044b4a6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.151067 May 17 12:11:54.495292 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 271/555] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:54 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:55.512314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3819a765-a53f-4407-8a95-9733b9aa8d69 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:55.512949 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3819a765-a53f-4407-8a95-9733b9aa8d69 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:55.520038 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3819a765-a53f-4407-8a95-9733b9aa8d69 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:55.520514 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3819a765-a53f-4407-8a95-9733b9aa8d69 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:55.521309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3819a765-a53f-4407-8a95-9733b9aa8d69 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:55.521752 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3819a765-a53f-4407-8a95-9733b9aa8d69 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:55.651897 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3819a765-a53f-4407-8a95-9733b9aa8d69 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:55.659891 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3819a765-a53f-4407-8a95-9733b9aa8d69 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.151444 May 17 12:11:55.660487 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 285/556] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:55 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:56.677391 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c776ae48-eeff-4700-84c1-d2b14043695e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:56.678006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c776ae48-eeff-4700-84c1-d2b14043695e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:56.684474 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c776ae48-eeff-4700-84c1-d2b14043695e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:56.684925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c776ae48-eeff-4700-84c1-d2b14043695e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:56.685690 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c776ae48-eeff-4700-84c1-d2b14043695e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:56.686128 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c776ae48-eeff-4700-84c1-d2b14043695e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:56.813640 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c776ae48-eeff-4700-84c1-d2b14043695e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:56.822774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c776ae48-eeff-4700-84c1-d2b14043695e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.149008 May 17 12:11:56.823359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 272/557] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:56 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:57.839080 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c0611f6e-bba8-4f3b-a14f-17b1cbdf8f72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:57.839694 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c0611f6e-bba8-4f3b-a14f-17b1cbdf8f72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:57.846756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c0611f6e-bba8-4f3b-a14f-17b1cbdf8f72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:57.847204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c0611f6e-bba8-4f3b-a14f-17b1cbdf8f72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:57.847969 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c0611f6e-bba8-4f3b-a14f-17b1cbdf8f72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:57.848434 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c0611f6e-bba8-4f3b-a14f-17b1cbdf8f72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:57.973566 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c0611f6e-bba8-4f3b-a14f-17b1cbdf8f72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:57.981303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c0611f6e-bba8-4f3b-a14f-17b1cbdf8f72 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.146205 May 17 12:11:57.981875 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 286/558] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:57 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:11:58.998316 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e0b36df2-f53d-4379-8023-a158ab5d39e6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:11:58.998922 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e0b36df2-f53d-4379-8023-a158ab5d39e6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:11:59.005826 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0b36df2-f53d-4379-8023-a158ab5d39e6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:59.006280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0b36df2-f53d-4379-8023-a158ab5d39e6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:59.007049 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0b36df2-f53d-4379-8023-a158ab5d39e6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:11:59.007486 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0b36df2-f53d-4379-8023-a158ab5d39e6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:11:59.137045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e0b36df2-f53d-4379-8023-a158ab5d39e6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:11:59.145082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e0b36df2-f53d-4379-8023-a158ab5d39e6 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.150655 May 17 12:11:59.145675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 273/559] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:11:58 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:00.162655 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8040aad6-59a3-421e-83ce-b76f64bd3cf7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:00.163271 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8040aad6-59a3-421e-83ce-b76f64bd3cf7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:00.169694 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8040aad6-59a3-421e-83ce-b76f64bd3cf7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:00.170149 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8040aad6-59a3-421e-83ce-b76f64bd3cf7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:00.170918 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8040aad6-59a3-421e-83ce-b76f64bd3cf7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:00.171360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8040aad6-59a3-421e-83ce-b76f64bd3cf7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:00.302981 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8040aad6-59a3-421e-83ce-b76f64bd3cf7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:00.310719 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8040aad6-59a3-421e-83ce-b76f64bd3cf7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.152471 May 17 12:12:00.311293 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 287/560] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:00 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:01.328059 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-dd99f303-bac6-42d6-9ba7-c9be59907398 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:01.328725 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-dd99f303-bac6-42d6-9ba7-c9be59907398 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:01.335143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dd99f303-bac6-42d6-9ba7-c9be59907398 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:01.335595 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dd99f303-bac6-42d6-9ba7-c9be59907398 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:01.336397 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dd99f303-bac6-42d6-9ba7-c9be59907398 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:01.336838 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dd99f303-bac6-42d6-9ba7-c9be59907398 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:01.460904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-dd99f303-bac6-42d6-9ba7-c9be59907398 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:01.471074 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-dd99f303-bac6-42d6-9ba7-c9be59907398 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.146899 May 17 12:12:01.471642 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 274/561] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:01 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:02.488513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5ba1fff8-b221-4fad-bb42-56e5c59486e4 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:02.489122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5ba1fff8-b221-4fad-bb42-56e5c59486e4 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:02.495454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5ba1fff8-b221-4fad-bb42-56e5c59486e4 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:02.495895 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5ba1fff8-b221-4fad-bb42-56e5c59486e4 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:02.496688 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5ba1fff8-b221-4fad-bb42-56e5c59486e4 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:02.497120 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5ba1fff8-b221-4fad-bb42-56e5c59486e4 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:02.624302 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5ba1fff8-b221-4fad-bb42-56e5c59486e4 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:02.632552 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5ba1fff8-b221-4fad-bb42-56e5c59486e4 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.148149 May 17 12:12:02.633127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 288/562] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:02 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:03.649688 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a8aa3883-8297-43c2-a1f5-6c0374f0d1ea tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:03.650301 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a8aa3883-8297-43c2-a1f5-6c0374f0d1ea tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:03.657819 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a8aa3883-8297-43c2-a1f5-6c0374f0d1ea tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:03.658879 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a8aa3883-8297-43c2-a1f5-6c0374f0d1ea tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:03.659691 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a8aa3883-8297-43c2-a1f5-6c0374f0d1ea tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:03.660125 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a8aa3883-8297-43c2-a1f5-6c0374f0d1ea tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:03.787319 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a8aa3883-8297-43c2-a1f5-6c0374f0d1ea tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:03.795013 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a8aa3883-8297-43c2-a1f5-6c0374f0d1ea tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.149200 May 17 12:12:03.795588 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 275/563] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:03 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:04.812274 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fd09ccb2-91b7-4524-8847-b8cf82e70c70 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:04.812817 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fd09ccb2-91b7-4524-8847-b8cf82e70c70 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:04.819234 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd09ccb2-91b7-4524-8847-b8cf82e70c70 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:04.819706 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd09ccb2-91b7-4524-8847-b8cf82e70c70 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:04.820482 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd09ccb2-91b7-4524-8847-b8cf82e70c70 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:04.820920 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd09ccb2-91b7-4524-8847-b8cf82e70c70 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:04.948034 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fd09ccb2-91b7-4524-8847-b8cf82e70c70 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:04.959170 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fd09ccb2-91b7-4524-8847-b8cf82e70c70 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.150841 May 17 12:12:04.959991 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 289/564] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:04 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:05.976174 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ec5a265f-fea9-4b5f-a7ce-63de1be63b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:05.976811 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ec5a265f-fea9-4b5f-a7ce-63de1be63b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:05.983106 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ec5a265f-fea9-4b5f-a7ce-63de1be63b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:05.983556 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ec5a265f-fea9-4b5f-a7ce-63de1be63b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:05.984360 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ec5a265f-fea9-4b5f-a7ce-63de1be63b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:05.984799 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ec5a265f-fea9-4b5f-a7ce-63de1be63b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:06.107912 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ec5a265f-fea9-4b5f-a7ce-63de1be63b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:06.116426 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ec5a265f-fea9-4b5f-a7ce-63de1be63b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.144003 May 17 12:12:06.117004 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 276/565] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:05 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:07.133946 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-448cdea6-4d72-4185-9ec9-5843a59045a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:07.134524 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-448cdea6-4d72-4185-9ec9-5843a59045a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:07.140843 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-448cdea6-4d72-4185-9ec9-5843a59045a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:07.141288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-448cdea6-4d72-4185-9ec9-5843a59045a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:07.142044 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-448cdea6-4d72-4185-9ec9-5843a59045a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:07.143127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-448cdea6-4d72-4185-9ec9-5843a59045a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:07.275185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-448cdea6-4d72-4185-9ec9-5843a59045a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:07.282928 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-448cdea6-4d72-4185-9ec9-5843a59045a1 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.152920 May 17 12:12:07.283580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 290/566] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:07 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:08.300113 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a249a707-315b-49df-870a-7e39f6f03537 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:08.300748 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a249a707-315b-49df-870a-7e39f6f03537 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:08.307041 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a249a707-315b-49df-870a-7e39f6f03537 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:08.307488 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a249a707-315b-49df-870a-7e39f6f03537 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:08.308278 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a249a707-315b-49df-870a-7e39f6f03537 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:08.308717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a249a707-315b-49df-870a-7e39f6f03537 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:08.435099 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a249a707-315b-49df-870a-7e39f6f03537 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:08.443326 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a249a707-315b-49df-870a-7e39f6f03537 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.147094 May 17 12:12:08.443889 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 277/567] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:08 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:09.462359 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2a566b55-48a3-497e-93c3-b416e4c2865f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:09.462912 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2a566b55-48a3-497e-93c3-b416e4c2865f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:09.469253 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a566b55-48a3-497e-93c3-b416e4c2865f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:09.469708 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a566b55-48a3-497e-93c3-b416e4c2865f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:09.470479 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a566b55-48a3-497e-93c3-b416e4c2865f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:09.470922 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2a566b55-48a3-497e-93c3-b416e4c2865f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:09.604620 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2a566b55-48a3-497e-93c3-b416e4c2865f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:09.613063 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2a566b55-48a3-497e-93c3-b416e4c2865f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.155247 May 17 12:12:09.613641 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 291/568] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:09 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:10.630675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-622c79e7-b3ec-4f54-b3c5-6842d79108ab tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:10.631287 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-622c79e7-b3ec-4f54-b3c5-6842d79108ab tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:10.637668 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-622c79e7-b3ec-4f54-b3c5-6842d79108ab tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:10.638116 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-622c79e7-b3ec-4f54-b3c5-6842d79108ab tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:10.638886 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-622c79e7-b3ec-4f54-b3c5-6842d79108ab tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:10.639320 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-622c79e7-b3ec-4f54-b3c5-6842d79108ab tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:10.763842 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-622c79e7-b3ec-4f54-b3c5-6842d79108ab tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:10.771722 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-622c79e7-b3ec-4f54-b3c5-6842d79108ab tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1738 microversion: 2.1 time: 0.145535 May 17 12:12:10.772321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 278/569] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:10 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:11.789861 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5dadf342-5f3f-47bb-9bbf-3b5dff273456 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:11.790417 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5dadf342-5f3f-47bb-9bbf-3b5dff273456 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:11.796653 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5dadf342-5f3f-47bb-9bbf-3b5dff273456 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:11.797096 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5dadf342-5f3f-47bb-9bbf-3b5dff273456 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:11.797851 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5dadf342-5f3f-47bb-9bbf-3b5dff273456 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:11.798285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5dadf342-5f3f-47bb-9bbf-3b5dff273456 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:11.925939 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5dadf342-5f3f-47bb-9bbf-3b5dff273456 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:11.933692 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5dadf342-5f3f-47bb-9bbf-3b5dff273456 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1718 microversion: 2.1 time: 0.147797 May 17 12:12:11.934265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 292/570] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:11 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1718 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:11.989168 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-724a57eb-3f6a-4389-b17e-591c469fc9f9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:11.989655 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-724a57eb-3f6a-4389-b17e-591c469fc9f9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:11.995967 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-724a57eb-3f6a-4389-b17e-591c469fc9f9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:11.996454 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-724a57eb-3f6a-4389-b17e-591c469fc9f9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:11.997214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-724a57eb-3f6a-4389-b17e-591c469fc9f9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:11.997646 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-724a57eb-3f6a-4389-b17e-591c469fc9f9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:12.077095 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-724a57eb-3f6a-4389-b17e-591c469fc9f9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] HTTP exception thrown: Cannot 'detach_volume' instance ce70576a-62fb-4bcc-9163-cfc28131518a while it is in vm_state rescued May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-724a57eb-3f6a-4389-b17e-591c469fc9f9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Request method failure captured: May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: DELETE /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments/df795007-e2ba-4c1e-a565-f2d28d4c7182 HTTP/1.1 May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_ROk_1fuk4cSz3epPRbBpZJb2CV0MrGgAAQniHK1q4v073xWwEWOCjjjbaAzyH7LF1w321FNwq0gXKnr2mWTL4XsT6HSoqme_-3QFRdTe7OIjs4JYtwiPMJL6MsQslc-YpYZVP_mTuVvFoGMYBqqzFJ4V0WOb3GzluE0C5CvbO6aA May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 748d013ae6664fc79a9ac23e58f642e5 May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:12:12.078740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/748d013ae6664fc79a9ac23e58f642e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_748d013ae6664fc79a9ac23e58f642e5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/748d013ae6664fc79a9ac23e58f642e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/748d013ae6664fc79a9ac23e58f642e5"}]}] May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 748d013ae6664fc79a9ac23e58f642e5 May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-ServerRescueNegativeTestJSON-320091299-project May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: bb9da9200f804a4a987f2cdb49f6801d May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-ServerRescueNegativeTestJSON-320091299-project May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:12:12.081056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Cannot 'detach_volume' instance ce70576a-62fb-4bcc-9163-cfc28131518a while it is in vm_state rescued May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'server_id': 'ce70576a-62fb-4bcc-9163-cfc28131518a', 'id': 'df795007-e2ba-4c1e-a565-f2d28d4c7182'} May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ce70576a-62fb-4bcc-9163-cfc28131518a in vm_state rescued. Cannot detach_volume while the instance is in this state. May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:12:12.081863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ce70576a-62fb-4bcc-9163-cfc28131518a while it is in vm_state rescued May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ce70576a-62fb-4bcc-9163-cfc28131518a while it is in vm_state rescued May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:12:12.083376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-724a57eb-3f6a-4389-b17e-591c469fc9f9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Returning 409 to user: Cannot 'detach_volume' instance ce70576a-62fb-4bcc-9163-cfc28131518a while it is in vm_state rescued {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:12:12.084754 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-724a57eb-3f6a-4389-b17e-591c469fc9f9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments/df795007-e2ba-4c1e-a565-f2d28d4c7182" status: 409 len: 152 microversion: 2.1 time: 0.094971 May 17 12:12:12.084754 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 279/571] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:12:11 2022] DELETE /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments/df795007-e2ba-4c1e-a565-f2d28d4c7182 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 17 12:12:12.089711 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ce68fa10-00a1-4c3f-b4db-2de6bb00b562 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:12.090240 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ce68fa10-00a1-4c3f-b4db-2de6bb00b562 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:12.096892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce68fa10-00a1-4c3f-b4db-2de6bb00b562 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:12.097339 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce68fa10-00a1-4c3f-b4db-2de6bb00b562 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:12.098101 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce68fa10-00a1-4c3f-b4db-2de6bb00b562 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:12.098536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce68fa10-00a1-4c3f-b4db-2de6bb00b562 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:12.162558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ce68fa10-00a1-4c3f-b4db-2de6bb00b562 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "POST /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/action" status: 202 len: 0 microversion: 2.1 time: 0.076458 May 17 12:12:12.163223 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 293/572] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:12:12 2022] POST /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:12:12.171311 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2ff1b832-de7b-43b8-a1b4-3482681689a5 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:12.171928 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2ff1b832-de7b-43b8-a1b4-3482681689a5 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:12.181845 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2ff1b832-de7b-43b8-a1b4-3482681689a5 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:12.182301 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2ff1b832-de7b-43b8-a1b4-3482681689a5 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:12.183089 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2ff1b832-de7b-43b8-a1b4-3482681689a5 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:12.183587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2ff1b832-de7b-43b8-a1b4-3482681689a5 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:12.403332 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2ff1b832-de7b-43b8-a1b4-3482681689a5 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:12.411082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2ff1b832-de7b-43b8-a1b4-3482681689a5 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1726 microversion: 2.1 time: 0.243508 May 17 12:12:12.411764 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 280/573] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:12 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:13.429971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5af0db32-a71c-4585-852c-dd4c1584c302 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:13.430661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5af0db32-a71c-4585-852c-dd4c1584c302 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:13.436740 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5af0db32-a71c-4585-852c-dd4c1584c302 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:13.437186 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5af0db32-a71c-4585-852c-dd4c1584c302 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:13.437946 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5af0db32-a71c-4585-852c-dd4c1584c302 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:13.438378 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5af0db32-a71c-4585-852c-dd4c1584c302 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:13.564106 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5af0db32-a71c-4585-852c-dd4c1584c302 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:13.573546 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5af0db32-a71c-4585-852c-dd4c1584c302 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1726 microversion: 2.1 time: 0.148236 May 17 12:12:13.574106 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 294/574] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:13 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:14.590868 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-76558e43-bdfe-4af1-a6ec-d205c8575445 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:14.591478 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-76558e43-bdfe-4af1-a6ec-d205c8575445 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:14.597825 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76558e43-bdfe-4af1-a6ec-d205c8575445 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:14.598276 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76558e43-bdfe-4af1-a6ec-d205c8575445 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:14.599041 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76558e43-bdfe-4af1-a6ec-d205c8575445 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:14.599472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76558e43-bdfe-4af1-a6ec-d205c8575445 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:14.725642 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-76558e43-bdfe-4af1-a6ec-d205c8575445 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:14.733331 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-76558e43-bdfe-4af1-a6ec-d205c8575445 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1726 microversion: 2.1 time: 0.146279 May 17 12:12:14.733899 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 281/575] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:14 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1726 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:15.751317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-06ab405d-d13e-43de-bb6c-6e7523fa9fac tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:15.752807 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-06ab405d-d13e-43de-bb6c-6e7523fa9fac tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:15.759570 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-06ab405d-d13e-43de-bb6c-6e7523fa9fac tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:15.760409 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-06ab405d-d13e-43de-bb6c-6e7523fa9fac tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:15.761479 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-06ab405d-d13e-43de-bb6c-6e7523fa9fac tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:15.762137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-06ab405d-d13e-43de-bb6c-6e7523fa9fac tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:15.889627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-06ab405d-d13e-43de-bb6c-6e7523fa9fac tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:15.897937 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-06ab405d-d13e-43de-bb6c-6e7523fa9fac tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1732 microversion: 2.1 time: 0.151063 May 17 12:12:15.898504 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 295/576] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:15 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:15.914716 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b1e32843-94e8-422c-9fb0-9a90efcc8a19 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:15.915214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b1e32843-94e8-422c-9fb0-9a90efcc8a19 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:15.921476 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b1e32843-94e8-422c-9fb0-9a90efcc8a19 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:15.921925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b1e32843-94e8-422c-9fb0-9a90efcc8a19 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:15.922691 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b1e32843-94e8-422c-9fb0-9a90efcc8a19 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:15.923130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b1e32843-94e8-422c-9fb0-9a90efcc8a19 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:16.002927 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b1e32843-94e8-422c-9fb0-9a90efcc8a19 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092036 May 17 12:12:16.003561 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 282/577] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 17 12:12:15 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:12:16.970226 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-26cb82b4-d5c6-4a58-bfe5-8a848b80d98b req-ebd5210c-36b7-417b-8368-3a70e14aee5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce70576a-62fb-4bcc-9163-cfc28131518a", "tag": "50b482d3-375e-4f6c-9829-4b4c147b3dc5"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:16.978309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-26cb82b4-d5c6-4a58-bfe5-8a848b80d98b req-ebd5210c-36b7-417b-8368-3a70e14aee5e service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:16.978737 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-26cb82b4-d5c6-4a58-bfe5-8a848b80d98b req-ebd5210c-36b7-417b-8368-3a70e14aee5e service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:16.989483 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-26cb82b4-d5c6-4a58-bfe5-8a848b80d98b req-ebd5210c-36b7-417b-8368-3a70e14aee5e service nova] Creating event network-changed:50b482d3-375e-4f6c-9829-4b4c147b3dc5 for instance ce70576a-62fb-4bcc-9163-cfc28131518a on hv-cinder-83769 May 17 12:12:16.994528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-26cb82b4-d5c6-4a58-bfe5-8a848b80d98b req-ebd5210c-36b7-417b-8368-3a70e14aee5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161939 May 17 12:12:16.995123 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 296/578] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:12:19.009339 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-9b7becdb-9630-4203-9872-f8c855191a6d req-acc01350-d797-42d0-8ccc-b49714e57fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce70576a-62fb-4bcc-9163-cfc28131518a", "tag": "50b482d3-375e-4f6c-9829-4b4c147b3dc5"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:19.018076 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-9b7becdb-9630-4203-9872-f8c855191a6d req-acc01350-d797-42d0-8ccc-b49714e57fed service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:19.018520 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-9b7becdb-9630-4203-9872-f8c855191a6d req-acc01350-d797-42d0-8ccc-b49714e57fed service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:19.029128 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-9b7becdb-9630-4203-9872-f8c855191a6d req-acc01350-d797-42d0-8ccc-b49714e57fed service nova] Creating event network-changed:50b482d3-375e-4f6c-9829-4b4c147b3dc5 for instance ce70576a-62fb-4bcc-9163-cfc28131518a on hv-cinder-83769 May 17 12:12:19.034191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-9b7becdb-9630-4203-9872-f8c855191a6d req-acc01350-d797-42d0-8ccc-b49714e57fed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028940 May 17 12:12:19.034849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 283/579] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:12:28.396021 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f5b2c868-b221-4390-84e3-1919f735a132 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:28.396679 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f5b2c868-b221-4390-84e3-1919f735a132 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:28.402781 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f5b2c868-b221-4390-84e3-1919f735a132 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:28.403233 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f5b2c868-b221-4390-84e3-1919f735a132 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:28.404035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f5b2c868-b221-4390-84e3-1919f735a132 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:28.404523 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f5b2c868-b221-4390-84e3-1919f735a132 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:28.428378 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.objects.instance [None req-f5b2c868-b221-4390-84e3-1919f735a132 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lazy-loading 'flavor' on Instance uuid 30bf4c33-50e2-4e81-aa3e-98ef857d0628 {{(pid=117114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:12:28.497763 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f5b2c868-b221-4390-84e3-1919f735a132 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "POST /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628/action" status: 202 len: 0 microversion: 2.1 time: 0.106266 May 17 12:12:28.498399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 297/580] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:12:28 2022] POST /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:12:28.509375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6b4fa4ce-e1bf-4704-b3ba-b25b000746a4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:28.510072 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6b4fa4ce-e1bf-4704-b3ba-b25b000746a4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:28.516039 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6b4fa4ce-e1bf-4704-b3ba-b25b000746a4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:28.516553 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6b4fa4ce-e1bf-4704-b3ba-b25b000746a4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:28.517472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6b4fa4ce-e1bf-4704-b3ba-b25b000746a4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:28.518261 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6b4fa4ce-e1bf-4704-b3ba-b25b000746a4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:28.649728 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6b4fa4ce-e1bf-4704-b3ba-b25b000746a4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:28.656973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6b4fa4ce-e1bf-4704-b3ba-b25b000746a4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.153140 May 17 12:12:28.657536 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 284/581] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:28 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:29.675765 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ef7044fa-08f8-49ed-895d-fa3750b4cbb2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:29.676489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ef7044fa-08f8-49ed-895d-fa3750b4cbb2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:29.682693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ef7044fa-08f8-49ed-895d-fa3750b4cbb2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:29.683137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ef7044fa-08f8-49ed-895d-fa3750b4cbb2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:29.683907 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ef7044fa-08f8-49ed-895d-fa3750b4cbb2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:29.684378 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ef7044fa-08f8-49ed-895d-fa3750b4cbb2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:29.816735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ef7044fa-08f8-49ed-895d-fa3750b4cbb2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:29.824360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ef7044fa-08f8-49ed-895d-fa3750b4cbb2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.153389 May 17 12:12:29.824925 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 298/582] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:29 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:30.841148 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d5d67c88-11a5-4435-ad6e-a704ba83f2c0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:30.841675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d5d67c88-11a5-4435-ad6e-a704ba83f2c0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:30.848813 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d5d67c88-11a5-4435-ad6e-a704ba83f2c0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:30.849257 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d5d67c88-11a5-4435-ad6e-a704ba83f2c0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:30.850015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d5d67c88-11a5-4435-ad6e-a704ba83f2c0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:30.850446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d5d67c88-11a5-4435-ad6e-a704ba83f2c0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:30.981349 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d5d67c88-11a5-4435-ad6e-a704ba83f2c0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:30.988807 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d5d67c88-11a5-4435-ad6e-a704ba83f2c0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.151592 May 17 12:12:30.989379 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 285/583] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:30 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:32.006376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0d220924-c50a-4368-98ae-7c163f837b20 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:32.007021 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0d220924-c50a-4368-98ae-7c163f837b20 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:32.013280 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d220924-c50a-4368-98ae-7c163f837b20 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:32.013725 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d220924-c50a-4368-98ae-7c163f837b20 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:32.014488 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d220924-c50a-4368-98ae-7c163f837b20 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:32.014922 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d220924-c50a-4368-98ae-7c163f837b20 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:32.147954 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0d220924-c50a-4368-98ae-7c163f837b20 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:32.155685 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0d220924-c50a-4368-98ae-7c163f837b20 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.153327 May 17 12:12:32.156287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 299/584] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:32 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:33.175050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-08f96d8b-2b65-4f95-9f68-77abc47cebbf tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:33.175674 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-08f96d8b-2b65-4f95-9f68-77abc47cebbf tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:33.182018 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08f96d8b-2b65-4f95-9f68-77abc47cebbf tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:33.182457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08f96d8b-2b65-4f95-9f68-77abc47cebbf tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:33.183216 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08f96d8b-2b65-4f95-9f68-77abc47cebbf tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:33.183644 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08f96d8b-2b65-4f95-9f68-77abc47cebbf tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:33.313243 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-08f96d8b-2b65-4f95-9f68-77abc47cebbf tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:33.320687 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-08f96d8b-2b65-4f95-9f68-77abc47cebbf tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.150129 May 17 12:12:33.321249 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 286/585] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:33 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:33.676562 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-496e8634-e8c7-49d5-be0d-966970ad50cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:33.677059 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-496e8634-e8c7-49d5-be0d-966970ad50cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:33.682917 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-496e8634-e8c7-49d5-be0d-966970ad50cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:33.683365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-496e8634-e8c7-49d5-be0d-966970ad50cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:33.684133 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-496e8634-e8c7-49d5-be0d-966970ad50cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:33.684599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-496e8634-e8c7-49d5-be0d-966970ad50cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:33.707308 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-496e8634-e8c7-49d5-be0d-966970ad50cd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7/ips" status: 200 len: 148 microversion: 2.1 time: 0.131024 May 17 12:12:33.707863 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 300/586] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 17 12:12:33 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7/ips => generated 148 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:12:33.718304 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b765cf4e-98e8-4b75-b4c3-54e79b741967 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a2f17e4-eb5f-410a-b325-5b814353e38c"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:33.719465 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b765cf4e-98e8-4b75-b4c3-54e79b741967 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:33.725892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b765cf4e-98e8-4b75-b4c3-54e79b741967 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:33.726340 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b765cf4e-98e8-4b75-b4c3-54e79b741967 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:33.727094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b765cf4e-98e8-4b75-b4c3-54e79b741967 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:33.727524 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b765cf4e-98e8-4b75-b4c3-54e79b741967 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:33.802917 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-b765cf4e-98e8-4b75-b4c3-54e79b741967 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Invalid volume: volume 0a2f17e4-eb5f-410a-b325-5b814353e38c is already attached to instances: ed125da4-128c-4d7e-ae52-d42f71475d0d May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b765cf4e-98e8-4b75-b4c3-54e79b741967 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: POST /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7/os-volume_attachments HTTP/1.1 May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 74 May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:12:33.804869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {"volumeAttachment": {"volumeId": "0a2f17e4-eb5f-410a-b325-5b814353e38c"}} May 17 12:12:33.806443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Invalid volume: volume 0a2f17e4-eb5f-410a-b325-5b814353e38c is already attached to instances: ed125da4-128c-4d7e-ae52-d42f71475d0d May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'server_id': '3692e0a7-74c5-43c9-8047-bc13959c2db7', 'body': {'volumeAttachment': {'volumeId': '0a2f17e4-eb5f-410a-b325-5b814353e38c'}}} May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0a2f17e4-eb5f-410a-b325-5b814353e38c is already attached to instances: ed125da4-128c-4d7e-ae52-d42f71475d0d May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:12:33.807419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0a2f17e4-eb5f-410a-b325-5b814353e38c is already attached to instances: ed125da4-128c-4d7e-ae52-d42f71475d0d May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:33.808865 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:12:33.810344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:12:33.810344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:12:33.810344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:12:33.810344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0a2f17e4-eb5f-410a-b325-5b814353e38c is already attached to instances: ed125da4-128c-4d7e-ae52-d42f71475d0d May 17 12:12:33.810344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:12:33.810344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b765cf4e-98e8-4b75-b4c3-54e79b741967 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 400 to user: Invalid volume: volume 0a2f17e4-eb5f-410a-b325-5b814353e38c is already attached to instances: ed125da4-128c-4d7e-ae52-d42f71475d0d {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:12:33.810344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b765cf4e-98e8-4b75-b4c3-54e79b741967 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092031 May 17 12:12:33.810344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 287/587] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:12:33 2022] POST /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 12:12:33.815975 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-13373597-4c7f-4227-8021-f806f35f52d0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:33.816498 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-13373597-4c7f-4227-8021-f806f35f52d0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:33.822374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-13373597-4c7f-4227-8021-f806f35f52d0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:33.823077 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-13373597-4c7f-4227-8021-f806f35f52d0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:33.823837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-13373597-4c7f-4227-8021-f806f35f52d0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:33.824301 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-13373597-4c7f-4227-8021-f806f35f52d0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:33.848885 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-13373597-4c7f-4227-8021-f806f35f52d0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:12:33.921832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-13373597-4c7f-4227-8021-f806f35f52d0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 204 len: 0 microversion: 2.1 time: 0.109414 May 17 12:12:33.922415 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 301/588] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:12:33 2022] DELETE /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:12:33.930955 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-cfa2dbe2-2dc4-4771-a814-1a3a9991b1a8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:33.931569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-cfa2dbe2-2dc4-4771-a814-1a3a9991b1a8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:33.938135 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cfa2dbe2-2dc4-4771-a814-1a3a9991b1a8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:33.938584 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cfa2dbe2-2dc4-4771-a814-1a3a9991b1a8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:33.939342 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cfa2dbe2-2dc4-4771-a814-1a3a9991b1a8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:33.940288 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-cfa2dbe2-2dc4-4771-a814-1a3a9991b1a8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:34.068764 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-cfa2dbe2-2dc4-4771-a814-1a3a9991b1a8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:34.076342 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-cfa2dbe2-2dc4-4771-a814-1a3a9991b1a8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1679 microversion: 2.1 time: 0.149379 May 17 12:12:34.076906 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 288/589] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:33 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:34.338397 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-67bb812b-6197-4c2f-a085-e3392882ed0d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:34.339020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-67bb812b-6197-4c2f-a085-e3392882ed0d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:34.345182 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-67bb812b-6197-4c2f-a085-e3392882ed0d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:34.345670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-67bb812b-6197-4c2f-a085-e3392882ed0d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:34.346476 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-67bb812b-6197-4c2f-a085-e3392882ed0d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:34.346934 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-67bb812b-6197-4c2f-a085-e3392882ed0d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:34.479758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-67bb812b-6197-4c2f-a085-e3392882ed0d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:34.487523 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-67bb812b-6197-4c2f-a085-e3392882ed0d tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.153433 May 17 12:12:34.488082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 302/590] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:34 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:35.094907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-45defcef-4853-4b6d-817b-16795e681dc6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:35.095438 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-45defcef-4853-4b6d-817b-16795e681dc6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:35.102166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-45defcef-4853-4b6d-817b-16795e681dc6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:35.102610 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-45defcef-4853-4b6d-817b-16795e681dc6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:35.103369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-45defcef-4853-4b6d-817b-16795e681dc6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:35.103802 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-45defcef-4853-4b6d-817b-16795e681dc6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:35.227486 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-45defcef-4853-4b6d-817b-16795e681dc6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:35.234677 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-45defcef-4853-4b6d-817b-16795e681dc6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1679 microversion: 2.1 time: 0.143651 May 17 12:12:35.235237 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 289/591] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:35 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1679 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:35.504453 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2931a149-58d2-4b69-ba61-de688d7f5853 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:35.505617 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2931a149-58d2-4b69-ba61-de688d7f5853 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:35.512986 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2931a149-58d2-4b69-ba61-de688d7f5853 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:35.513433 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2931a149-58d2-4b69-ba61-de688d7f5853 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:35.514208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2931a149-58d2-4b69-ba61-de688d7f5853 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:35.514642 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2931a149-58d2-4b69-ba61-de688d7f5853 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:35.650693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2931a149-58d2-4b69-ba61-de688d7f5853 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:35.658346 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2931a149-58d2-4b69-ba61-de688d7f5853 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.158330 May 17 12:12:35.659294 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 303/592] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:35 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:36.251348 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-dbd3eb26-ebf5-4fcf-8c1f-5e948ae88df0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:36.251969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-dbd3eb26-ebf5-4fcf-8c1f-5e948ae88df0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:36.258965 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dbd3eb26-ebf5-4fcf-8c1f-5e948ae88df0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:36.259469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dbd3eb26-ebf5-4fcf-8c1f-5e948ae88df0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:36.260382 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dbd3eb26-ebf5-4fcf-8c1f-5e948ae88df0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:36.260828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dbd3eb26-ebf5-4fcf-8c1f-5e948ae88df0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:36.488724 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-dbd3eb26-ebf5-4fcf-8c1f-5e948ae88df0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:36.496828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-dbd3eb26-ebf5-4fcf-8c1f-5e948ae88df0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1679 microversion: 2.1 time: 0.249426 May 17 12:12:36.497400 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 290/593] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:36 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:36.676195 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1c235ddd-a9cd-4b3a-82f5-6208e9269c47 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:36.677050 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1c235ddd-a9cd-4b3a-82f5-6208e9269c47 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:36.683283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c235ddd-a9cd-4b3a-82f5-6208e9269c47 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:36.683749 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c235ddd-a9cd-4b3a-82f5-6208e9269c47 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:36.684557 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c235ddd-a9cd-4b3a-82f5-6208e9269c47 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:36.684998 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c235ddd-a9cd-4b3a-82f5-6208e9269c47 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:36.815417 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1c235ddd-a9cd-4b3a-82f5-6208e9269c47 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:36.823194 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1c235ddd-a9cd-4b3a-82f5-6208e9269c47 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.151161 May 17 12:12:36.823855 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 304/594] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:36 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:37.145434 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-ea445315-9658-42fb-8453-cb9036b30ece req-b0e8b751-a312-492b-8c27-8cb1e2d60a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3692e0a7-74c5-43c9-8047-bc13959c2db7", "name": "network-vif-deleted", "tag": "7506035a-9a00-4a41-add4-17fb7a9190e6"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:37.160218 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-ea445315-9658-42fb-8453-cb9036b30ece req-b0e8b751-a312-492b-8c27-8cb1e2d60a3f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:37.161078 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-ea445315-9658-42fb-8453-cb9036b30ece req-b0e8b751-a312-492b-8c27-8cb1e2d60a3f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:37.172638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-ea445315-9658-42fb-8453-cb9036b30ece req-b0e8b751-a312-492b-8c27-8cb1e2d60a3f service nova] Creating event network-vif-deleted:7506035a-9a00-4a41-add4-17fb7a9190e6 for instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 on hv-cinder-83769 May 17 12:12:37.178129 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-ea445315-9658-42fb-8453-cb9036b30ece req-b0e8b751-a312-492b-8c27-8cb1e2d60a3f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036916 May 17 12:12:37.179329 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 291/595] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:12:37.514469 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:37.515219 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:37.521815 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:37.522272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:37.523061 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:37.523499 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:37.555669 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:37.556122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:37.556739 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.objects.instance [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lazy-loading 'fault' on Instance uuid 3692e0a7-74c5-43c9-8047-bc13959c2db7 {{(pid=117114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:12:37.605344 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:37.613159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-abef310d-9554-46c6-9620-6e4c058b7cb8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 200 len: 1331 microversion: 2.1 time: 0.102496 May 17 12:12:37.614102 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 305/596] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:37 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:37.841936 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1f8a696a-62e8-4589-89b4-fd44c37db5be tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:37.842692 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1f8a696a-62e8-4589-89b4-fd44c37db5be tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:37.849096 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f8a696a-62e8-4589-89b4-fd44c37db5be tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:37.849549 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f8a696a-62e8-4589-89b4-fd44c37db5be tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:37.850328 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f8a696a-62e8-4589-89b4-fd44c37db5be tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:37.850758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1f8a696a-62e8-4589-89b4-fd44c37db5be tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:37.991310 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1f8a696a-62e8-4589-89b4-fd44c37db5be tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:37.999241 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1f8a696a-62e8-4589-89b4-fd44c37db5be tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.162009 May 17 12:12:37.999821 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 292/597] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:37 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:38.630537 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7b996fec-6a66-47a5-87aa-01bc10c65b44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:38.631202 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7b996fec-6a66-47a5-87aa-01bc10c65b44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:38.637644 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7b996fec-6a66-47a5-87aa-01bc10c65b44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:38.638098 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7b996fec-6a66-47a5-87aa-01bc10c65b44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:38.638874 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7b996fec-6a66-47a5-87aa-01bc10c65b44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:38.639311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7b996fec-6a66-47a5-87aa-01bc10c65b44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:38.652899 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-7b996fec-6a66-47a5-87aa-01bc10c65b44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7b996fec-6a66-47a5-87aa-01bc10c65b44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 HTTP/1.1 May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:12:38.654558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:12:38.655848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '3692e0a7-74c5-43c9-8047-bc13959c2db7'} May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:12:38.656649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:12:38.657841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:12:38.659538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7b996fec-6a66-47a5-87aa-01bc10c65b44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:12:38.659538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7b996fec-6a66-47a5-87aa-01bc10c65b44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 404 len: 111 microversion: 2.1 time: 0.029425 May 17 12:12:38.659538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 306/598] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:38 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:12:38.665378 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-cfa2992e-68e2-460d-80f6-1195906465be tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '.version_select at 0x7f2db423e430>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:38.688218 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-cfa2992e-68e2-460d-80f6-1195906465be tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192214969" status: 202 len: 0 microversion: 2.1 time: 0.026631 May 17 12:12:38.688811 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 293/599] 10.222.0.58 () {58 vars in 1220 bytes} [Tue May 17 12:12:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192214969 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:12:39.018429 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9199e16c-29f3-4cc1-95b9-cd26ee1b4199 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:39.019687 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9199e16c-29f3-4cc1-95b9-cd26ee1b4199 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:39.026077 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9199e16c-29f3-4cc1-95b9-cd26ee1b4199 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:39.026832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9199e16c-29f3-4cc1-95b9-cd26ee1b4199 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:39.027987 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9199e16c-29f3-4cc1-95b9-cd26ee1b4199 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:39.028818 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9199e16c-29f3-4cc1-95b9-cd26ee1b4199 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:39.239229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9199e16c-29f3-4cc1-95b9-cd26ee1b4199 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:39.247688 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9199e16c-29f3-4cc1-95b9-cd26ee1b4199 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.233667 May 17 12:12:39.249079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 307/600] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:39 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:39.448846 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c60d9afe-4829-4c41-a8ab-8ad465b44c84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:39.449410 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c60d9afe-4829-4c41-a8ab-8ad465b44c84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:39.456715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c60d9afe-4829-4c41-a8ab-8ad465b44c84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:39.457471 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c60d9afe-4829-4c41-a8ab-8ad465b44c84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:39.458285 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c60d9afe-4829-4c41-a8ab-8ad465b44c84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:39.458732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c60d9afe-4829-4c41-a8ab-8ad465b44c84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:39.541148 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-c60d9afe-4829-4c41-a8ab-8ad465b44c84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lazy-loading 'services' on Instance uuid ed125da4-128c-4d7e-ae52-d42f71475d0d {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:12:39.631565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c60d9afe-4829-4c41-a8ab-8ad465b44c84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments/0a2f17e4-eb5f-410a-b325-5b814353e38c" status: 202 len: 0 microversion: 2.1 time: 0.186759 May 17 12:12:39.632408 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 294/601] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:12:39 2022] DELETE /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments/0a2f17e4-eb5f-410a-b325-5b814353e38c => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:12:39.640481 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-120c6d76-793b-4fa6-851f-6218e1052467 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:39.641486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-120c6d76-793b-4fa6-851f-6218e1052467 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:39.648533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-120c6d76-793b-4fa6-851f-6218e1052467 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:39.649187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-120c6d76-793b-4fa6-851f-6218e1052467 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:39.649955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-120c6d76-793b-4fa6-851f-6218e1052467 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:39.650387 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-120c6d76-793b-4fa6-851f-6218e1052467 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:39.679365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-120c6d76-793b-4fa6-851f-6218e1052467 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042749 May 17 12:12:39.679911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 308/602] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:12:39 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:12:39.829700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-db437cc4-a092-44d8-b657-4da5ece088b2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:39.830833 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-db437cc4-a092-44d8-b657-4da5ece088b2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:39.836977 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db437cc4-a092-44d8-b657-4da5ece088b2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:39.837425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db437cc4-a092-44d8-b657-4da5ece088b2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:39.838202 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db437cc4-a092-44d8-b657-4da5ece088b2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:39.838641 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db437cc4-a092-44d8-b657-4da5ece088b2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:39.917186 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-db437cc4-a092-44d8-b657-4da5ece088b2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lazy-loading 'services' on Instance uuid 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:12:39.986222 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-db437cc4-a092-44d8-b657-4da5ece088b2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/os-volume_attachments/278ab210-dd67-4e27-951d-25f0110abfc9" status: 202 len: 0 microversion: 2.1 time: 0.263587 May 17 12:12:39.986849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 295/603] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:12:39 2022] DELETE /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/os-volume_attachments/278ab210-dd67-4e27-951d-25f0110abfc9 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:12:40.266138 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-33bf1662-77ce-492f-b909-86d4db167546 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:40.266755 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-33bf1662-77ce-492f-b909-86d4db167546 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:40.273362 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-33bf1662-77ce-492f-b909-86d4db167546 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:40.273813 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-33bf1662-77ce-492f-b909-86d4db167546 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:40.274575 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-33bf1662-77ce-492f-b909-86d4db167546 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:40.275012 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-33bf1662-77ce-492f-b909-86d4db167546 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:40.406457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-33bf1662-77ce-492f-b909-86d4db167546 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:40.413959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-33bf1662-77ce-492f-b909-86d4db167546 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.151704 May 17 12:12:40.414524 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 309/604] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:40 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:40.692353 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5146eaf1-54bd-4108-a5ff-6ab16562c701 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:40.693362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5146eaf1-54bd-4108-a5ff-6ab16562c701 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:40.699818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5146eaf1-54bd-4108-a5ff-6ab16562c701 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:40.700292 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5146eaf1-54bd-4108-a5ff-6ab16562c701 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:40.701063 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5146eaf1-54bd-4108-a5ff-6ab16562c701 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:40.701501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5146eaf1-54bd-4108-a5ff-6ab16562c701 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:40.729629 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5146eaf1-54bd-4108-a5ff-6ab16562c701 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042411 May 17 12:12:40.730350 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 296/605] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:12:40 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:12:41.430930 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8e40f523-4ad7-4b59-92e7-c00a4da5ff11 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:41.431570 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8e40f523-4ad7-4b59-92e7-c00a4da5ff11 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:41.437851 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e40f523-4ad7-4b59-92e7-c00a4da5ff11 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:41.438300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e40f523-4ad7-4b59-92e7-c00a4da5ff11 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:41.439058 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e40f523-4ad7-4b59-92e7-c00a4da5ff11 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:41.439582 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e40f523-4ad7-4b59-92e7-c00a4da5ff11 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:41.566331 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8e40f523-4ad7-4b59-92e7-c00a4da5ff11 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:41.574289 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8e40f523-4ad7-4b59-92e7-c00a4da5ff11 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.147221 May 17 12:12:41.574863 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 310/606] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:41 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:41.741720 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9b442493-d60c-47f1-bb32-795d012ce294 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:41.742837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9b442493-d60c-47f1-bb32-795d012ce294 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:41.749092 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9b442493-d60c-47f1-bb32-795d012ce294 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:41.749530 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9b442493-d60c-47f1-bb32-795d012ce294 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:41.750326 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9b442493-d60c-47f1-bb32-795d012ce294 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:41.750759 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9b442493-d60c-47f1-bb32-795d012ce294 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:41.779358 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-9b442493-d60c-47f1-bb32-795d012ce294 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041505 May 17 12:12:41.779943 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 297/607] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:12:41 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:12:42.591713 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-eb5d41cf-c58c-453c-b159-1bb47af0ac0b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:42.592356 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-eb5d41cf-c58c-453c-b159-1bb47af0ac0b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:42.598465 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb5d41cf-c58c-453c-b159-1bb47af0ac0b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:42.598911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb5d41cf-c58c-453c-b159-1bb47af0ac0b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:42.599670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb5d41cf-c58c-453c-b159-1bb47af0ac0b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:42.600098 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb5d41cf-c58c-453c-b159-1bb47af0ac0b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:42.740974 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-eb5d41cf-c58c-453c-b159-1bb47af0ac0b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:42.748289 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-eb5d41cf-c58c-453c-b159-1bb47af0ac0b tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1568 microversion: 2.1 time: 0.160667 May 17 12:12:42.748859 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 311/608] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:42 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:42.764849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-98885869-7f27-466b-b20c-4b34a2d2e012 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:42.765428 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-98885869-7f27-466b-b20c-4b34a2d2e012 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:42.772357 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98885869-7f27-466b-b20c-4b34a2d2e012 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:42.772818 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98885869-7f27-466b-b20c-4b34a2d2e012 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:42.773596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98885869-7f27-466b-b20c-4b34a2d2e012 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:42.774039 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98885869-7f27-466b-b20c-4b34a2d2e012 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:42.790979 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4ed92bd7-a703-4c9a-8473-7572d132e082 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:42.791873 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4ed92bd7-a703-4c9a-8473-7572d132e082 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:42.797691 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4ed92bd7-a703-4c9a-8473-7572d132e082 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:42.798127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4ed92bd7-a703-4c9a-8473-7572d132e082 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:42.799393 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4ed92bd7-a703-4c9a-8473-7572d132e082 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:42.799830 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4ed92bd7-a703-4c9a-8473-7572d132e082 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:42.829933 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4ed92bd7-a703-4c9a-8473-7572d132e082 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042836 May 17 12:12:42.830764 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 312/609] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:12:42 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:12:42.850632 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-98885869-7f27-466b-b20c-4b34a2d2e012 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "POST /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628/action" status: 202 len: 0 microversion: 2.1 time: 0.089506 May 17 12:12:42.851306 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 298/610] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:12:42 2022] POST /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:12:42.859226 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0559ab7a-f96d-4bf6-8d3b-310a3c4fe417 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:42.859845 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0559ab7a-f96d-4bf6-8d3b-310a3c4fe417 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:42.866341 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0559ab7a-f96d-4bf6-8d3b-310a3c4fe417 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:42.866796 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0559ab7a-f96d-4bf6-8d3b-310a3c4fe417 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:42.867567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0559ab7a-f96d-4bf6-8d3b-310a3c4fe417 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:42.868008 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0559ab7a-f96d-4bf6-8d3b-310a3c4fe417 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:43.012150 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0559ab7a-f96d-4bf6-8d3b-310a3c4fe417 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:43.022298 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0559ab7a-f96d-4bf6-8d3b-310a3c4fe417 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1576 microversion: 2.1 time: 0.166773 May 17 12:12:43.023099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 313/611] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:42 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:43.203212 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0f5feb2b-c5f6-4c59-87ae-38bc15b1cfc0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:43.209653 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0f5feb2b-c5f6-4c59-87ae-38bc15b1cfc0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:43.210202 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0f5feb2b-c5f6-4c59-87ae-38bc15b1cfc0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:43.274002 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0f5feb2b-c5f6-4c59-87ae-38bc15b1cfc0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Going to try to stop instance {{(pid=117113) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 12:12:43.321121 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0f5feb2b-c5f6-4c59-87ae-38bc15b1cfc0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/action" status: 202 len: 0 microversion: 2.1 time: 0.121583 May 17 12:12:43.322084 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 299/612] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:12:43 2022] POST /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:12:43.330700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d10796dd-6b1b-4bcc-acfd-b46019f02b13 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:43.331392 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d10796dd-6b1b-4bcc-acfd-b46019f02b13 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:43.343279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d10796dd-6b1b-4bcc-acfd-b46019f02b13 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:43.343986 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d10796dd-6b1b-4bcc-acfd-b46019f02b13 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:43.345032 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d10796dd-6b1b-4bcc-acfd-b46019f02b13 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:43.346355 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d10796dd-6b1b-4bcc-acfd-b46019f02b13 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:43.486022 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d10796dd-6b1b-4bcc-acfd-b46019f02b13 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:43.493550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d10796dd-6b1b-4bcc-acfd-b46019f02b13 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1674 microversion: 2.1 time: 0.167261 May 17 12:12:43.494119 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 314/613] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:43 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:43.843008 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b28f0df7-a163-42db-9a44-e441921aade5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:43.844081 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b28f0df7-a163-42db-9a44-e441921aade5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:43.850706 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b28f0df7-a163-42db-9a44-e441921aade5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:43.851183 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b28f0df7-a163-42db-9a44-e441921aade5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:43.851907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b28f0df7-a163-42db-9a44-e441921aade5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:43.852386 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b28f0df7-a163-42db-9a44-e441921aade5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:43.883613 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b28f0df7-a163-42db-9a44-e441921aade5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045404 May 17 12:12:43.884263 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 300/614] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:12:43 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 12:12:43.938548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1ef4e09d-7f91-4a10-97fa-872dd78b3fe4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:43.939090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1ef4e09d-7f91-4a10-97fa-872dd78b3fe4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:43.946005 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1ef4e09d-7f91-4a10-97fa-872dd78b3fe4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:43.946451 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1ef4e09d-7f91-4a10-97fa-872dd78b3fe4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:43.947209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1ef4e09d-7f91-4a10-97fa-872dd78b3fe4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:43.947896 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1ef4e09d-7f91-4a10-97fa-872dd78b3fe4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:43.972709 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1ef4e09d-7f91-4a10-97fa-872dd78b3fe4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:12:44.040371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8c824ad8-2a87-4c70-9165-148fb41c79d3 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:44.041045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8c824ad8-2a87-4c70-9165-148fb41c79d3 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:44.046137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1ef4e09d-7f91-4a10-97fa-872dd78b3fe4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 204 len: 0 microversion: 2.1 time: 0.110892 May 17 12:12:44.046979 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 315/615] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:12:43 2022] DELETE /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:12:44.047101 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c824ad8-2a87-4c70-9165-148fb41c79d3 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:44.047439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c824ad8-2a87-4c70-9165-148fb41c79d3 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:44.048219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c824ad8-2a87-4c70-9165-148fb41c79d3 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:44.048658 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c824ad8-2a87-4c70-9165-148fb41c79d3 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:44.057106 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b71921c2-8748-4952-a869-8cb7e405cccf tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:44.057950 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b71921c2-8748-4952-a869-8cb7e405cccf tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:44.064116 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b71921c2-8748-4952-a869-8cb7e405cccf tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:44.065173 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b71921c2-8748-4952-a869-8cb7e405cccf tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:44.065950 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b71921c2-8748-4952-a869-8cb7e405cccf tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:44.066382 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b71921c2-8748-4952-a869-8cb7e405cccf tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:44.180294 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8c824ad8-2a87-4c70-9165-148fb41c79d3 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:44.187678 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8c824ad8-2a87-4c70-9165-148fb41c79d3 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1518 microversion: 2.1 time: 0.151589 May 17 12:12:44.188269 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 301/616] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:44 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:44.199806 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b71921c2-8748-4952-a869-8cb7e405cccf tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:44.207778 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b71921c2-8748-4952-a869-8cb7e405cccf tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1681 microversion: 2.1 time: 0.156043 May 17 12:12:44.208384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 316/617] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:44 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:44.510708 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e0f17153-01e1-4aa3-87b1-ef974375063c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:44.511314 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e0f17153-01e1-4aa3-87b1-ef974375063c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:44.517159 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0f17153-01e1-4aa3-87b1-ef974375063c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:44.517643 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0f17153-01e1-4aa3-87b1-ef974375063c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:44.518693 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0f17153-01e1-4aa3-87b1-ef974375063c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:44.519133 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e0f17153-01e1-4aa3-87b1-ef974375063c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:44.661622 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e0f17153-01e1-4aa3-87b1-ef974375063c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:44.668978 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e0f17153-01e1-4aa3-87b1-ef974375063c tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1674 microversion: 2.1 time: 0.162084 May 17 12:12:44.669555 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 302/618] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:44 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:45.205166 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-19100d0f-9d48-4848-a174-885cdaccb75a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:45.205869 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-19100d0f-9d48-4848-a174-885cdaccb75a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:45.212296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-19100d0f-9d48-4848-a174-885cdaccb75a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:45.212751 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-19100d0f-9d48-4848-a174-885cdaccb75a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:45.213521 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-19100d0f-9d48-4848-a174-885cdaccb75a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:45.213969 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-19100d0f-9d48-4848-a174-885cdaccb75a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:45.224265 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ad65ae2b-5e8f-41a6-86a9-e5cd17f3ac6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:45.224841 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ad65ae2b-5e8f-41a6-86a9-e5cd17f3ac6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:45.231058 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ad65ae2b-5e8f-41a6-86a9-e5cd17f3ac6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:45.231505 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ad65ae2b-5e8f-41a6-86a9-e5cd17f3ac6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:45.232299 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ad65ae2b-5e8f-41a6-86a9-e5cd17f3ac6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:45.232732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ad65ae2b-5e8f-41a6-86a9-e5cd17f3ac6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:45.347080 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-19100d0f-9d48-4848-a174-885cdaccb75a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:45.354549 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-19100d0f-9d48-4848-a174-885cdaccb75a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1574 microversion: 2.1 time: 0.153292 May 17 12:12:45.355124 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 317/619] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:45 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:45.366743 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ad65ae2b-5e8f-41a6-86a9-e5cd17f3ac6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:45.374127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ad65ae2b-5e8f-41a6-86a9-e5cd17f3ac6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1681 microversion: 2.1 time: 0.154186 May 17 12:12:45.374700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 303/620] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:45 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:45.686717 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9fbfd8df-a4d9-40db-9341-698e2f9fcb6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:45.687330 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9fbfd8df-a4d9-40db-9341-698e2f9fcb6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:45.693950 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9fbfd8df-a4d9-40db-9341-698e2f9fcb6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:45.694607 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9fbfd8df-a4d9-40db-9341-698e2f9fcb6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:45.696411 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9fbfd8df-a4d9-40db-9341-698e2f9fcb6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:45.697013 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9fbfd8df-a4d9-40db-9341-698e2f9fcb6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:45.819890 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-e6b4a389-a5da-4dce-b3f4-57634d6873db req-f7f6f96a-874c-43eb-ab62-689d7de66398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bf4c33-50e2-4e81-aa3e-98ef857d0628", "name": "network-vif-unplugged", "status": "completed", "tag": "ce775399-8aaa-44e2-8bad-de44d822b044"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:45.835770 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-e6b4a389-a5da-4dce-b3f4-57634d6873db req-f7f6f96a-874c-43eb-ab62-689d7de66398 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:45.836391 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-e6b4a389-a5da-4dce-b3f4-57634d6873db req-f7f6f96a-874c-43eb-ab62-689d7de66398 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:45.849463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-e6b4a389-a5da-4dce-b3f4-57634d6873db req-f7f6f96a-874c-43eb-ab62-689d7de66398 service nova] Creating event network-vif-unplugged:ce775399-8aaa-44e2-8bad-de44d822b044 for instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 on hv-cinder-83769 May 17 12:12:45.854605 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-e6b4a389-a5da-4dce-b3f4-57634d6873db req-f7f6f96a-874c-43eb-ab62-689d7de66398 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124279 May 17 12:12:45.855217 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 304/621] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:12:45.934733 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9fbfd8df-a4d9-40db-9341-698e2f9fcb6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:45.942893 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9fbfd8df-a4d9-40db-9341-698e2f9fcb6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1674 microversion: 2.1 time: 0.259908 May 17 12:12:45.944030 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 318/622] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:45 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1674 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:46.374460 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-890bbe8a-bce2-42a7-b763-c24463217b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:46.375150 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-890bbe8a-bce2-42a7-b763-c24463217b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:46.383120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-890bbe8a-bce2-42a7-b763-c24463217b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:46.383760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-890bbe8a-bce2-42a7-b763-c24463217b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:46.384738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-890bbe8a-bce2-42a7-b763-c24463217b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:46.385375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-890bbe8a-bce2-42a7-b763-c24463217b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:46.446454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-7dccba25-b093-4ef1-bbcc-9cd6071251bc req-f847f8f0-fbee-45b4-899c-11a7796ce673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed125da4-128c-4d7e-ae52-d42f71475d0d", "name": "network-vif-deleted", "tag": "e9c1c53c-8160-4739-98f3-05a522031fb3"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:46.456406 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-7dccba25-b093-4ef1-bbcc-9cd6071251bc req-f847f8f0-fbee-45b4-899c-11a7796ce673 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:46.456673 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-7dccba25-b093-4ef1-bbcc-9cd6071251bc req-f847f8f0-fbee-45b4-899c-11a7796ce673 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:46.472160 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-7dccba25-b093-4ef1-bbcc-9cd6071251bc req-f847f8f0-fbee-45b4-899c-11a7796ce673 service nova] Creating event network-vif-deleted:e9c1c53c-8160-4739-98f3-05a522031fb3 for instance ed125da4-128c-4d7e-ae52-d42f71475d0d on hv-cinder-83769 May 17 12:12:46.477964 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-7dccba25-b093-4ef1-bbcc-9cd6071251bc req-f847f8f0-fbee-45b4-899c-11a7796ce673 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095459 May 17 12:12:46.479197 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 319/623] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:12:46.485346 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-96ac32e6-9ee2-4f7f-afb6-430adaa4b594 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:46.488340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-96ac32e6-9ee2-4f7f-afb6-430adaa4b594 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:46.497208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-96ac32e6-9ee2-4f7f-afb6-430adaa4b594 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:46.497678 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-96ac32e6-9ee2-4f7f-afb6-430adaa4b594 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:46.499095 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-96ac32e6-9ee2-4f7f-afb6-430adaa4b594 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:46.499560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-96ac32e6-9ee2-4f7f-afb6-430adaa4b594 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:46.578376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-890bbe8a-bce2-42a7-b763-c24463217b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:46.588776 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-890bbe8a-bce2-42a7-b763-c24463217b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1574 microversion: 2.1 time: 0.219323 May 17 12:12:46.592283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-96ac32e6-9ee2-4f7f-afb6-430adaa4b594 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:46.600282 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 305/624] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:46 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1574 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:46.600625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-96ac32e6-9ee2-4f7f-afb6-430adaa4b594 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1614 microversion: 2.1 time: 0.119841 May 17 12:12:46.601220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 320/625] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:46 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1614 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:46.961894 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d0dd4493-625e-4d35-9ce6-638deaa7d0a8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:46.962506 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d0dd4493-625e-4d35-9ce6-638deaa7d0a8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:46.968401 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0dd4493-625e-4d35-9ce6-638deaa7d0a8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:46.968854 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0dd4493-625e-4d35-9ce6-638deaa7d0a8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:46.969645 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0dd4493-625e-4d35-9ce6-638deaa7d0a8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:46.970154 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0dd4493-625e-4d35-9ce6-638deaa7d0a8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:47.102315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d0dd4493-625e-4d35-9ce6-638deaa7d0a8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:47.109921 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d0dd4493-625e-4d35-9ce6-638deaa7d0a8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1674 microversion: 2.1 time: 0.151834 May 17 12:12:47.110588 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 306/626] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:46 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:47.613220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-788b2871-fe4d-4002-a5ad-4d7b3b499b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:47.613842 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-788b2871-fe4d-4002-a5ad-4d7b3b499b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:47.618128 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:47.618753 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:47.620289 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-788b2871-fe4d-4002-a5ad-4d7b3b499b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:47.620683 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-788b2871-fe4d-4002-a5ad-4d7b3b499b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:47.621459 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-788b2871-fe4d-4002-a5ad-4d7b3b499b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:47.622038 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-788b2871-fe4d-4002-a5ad-4d7b3b499b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:47.625060 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:47.625515 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:47.626284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:47.626723 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:47.659380 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:47.659836 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:47.660311 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lazy-loading 'fault' on Instance uuid ed125da4-128c-4d7e-ae52-d42f71475d0d {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:12:47.701972 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:47.709370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a04585ef-ca8a-460f-b3c5-a3e74b61722f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 200 len: 1332 microversion: 2.1 time: 0.095146 May 17 12:12:47.709974 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 307/627] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:47 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:47.758096 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-788b2871-fe4d-4002-a5ad-4d7b3b499b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:47.765548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-788b2871-fe4d-4002-a5ad-4d7b3b499b59 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1574 microversion: 2.1 time: 0.157017 May 17 12:12:47.766145 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 321/628] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:47 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:48.127530 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-12f58637-6a63-4854-bf80-e3f489372181 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:48.128030 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-12f58637-6a63-4854-bf80-e3f489372181 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:48.133965 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12f58637-6a63-4854-bf80-e3f489372181 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:48.134416 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12f58637-6a63-4854-bf80-e3f489372181 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:48.135174 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12f58637-6a63-4854-bf80-e3f489372181 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:48.135602 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-12f58637-6a63-4854-bf80-e3f489372181 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:48.264710 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-12f58637-6a63-4854-bf80-e3f489372181 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:48.272443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-12f58637-6a63-4854-bf80-e3f489372181 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1674 microversion: 2.1 time: 0.149372 May 17 12:12:48.273015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 308/629] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:48 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:48.726009 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d8f85c28-669d-4bad-ae04-954711b0f105 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:48.726629 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d8f85c28-669d-4bad-ae04-954711b0f105 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:48.732962 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d8f85c28-669d-4bad-ae04-954711b0f105 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:48.733415 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d8f85c28-669d-4bad-ae04-954711b0f105 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:48.734180 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d8f85c28-669d-4bad-ae04-954711b0f105 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:48.734619 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d8f85c28-669d-4bad-ae04-954711b0f105 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:48.747772 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-d8f85c28-669d-4bad-ae04-954711b0f105 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d8f85c28-669d-4bad-ae04-954711b0f105 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d HTTP/1.1 May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:12:48.749399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:12:48.750837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'ed125da4-128c-4d7e-ae52-d42f71475d0d'} May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:12:48.751627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:12:48.753185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:12:48.754437 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d8f85c28-669d-4bad-ae04-954711b0f105 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:12:48.754437 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d8f85c28-669d-4bad-ae04-954711b0f105 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 404 len: 111 microversion: 2.1 time: 0.028570 May 17 12:12:48.754437 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 322/630] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:48 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:12:48.759448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0773a348-5d31-4260-8364-386c7589c1a1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '.version_select at 0x7f2db4284e50>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:48.777223 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0773a348-5d31-4260-8364-386c7589c1a1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113558038" status: 202 len: 0 microversion: 2.1 time: 0.021493 May 17 12:12:48.777822 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 309/631] 10.222.0.58 () {58 vars in 1220 bytes} [Tue May 17 12:12:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113558038 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:12:48.791939 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-54f9f952-de49-4559-a0b8-3436e89dcf94 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:48.792809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-54f9f952-de49-4559-a0b8-3436e89dcf94 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:48.798595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-54f9f952-de49-4559-a0b8-3436e89dcf94 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:48.799681 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-54f9f952-de49-4559-a0b8-3436e89dcf94 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:48.800490 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-54f9f952-de49-4559-a0b8-3436e89dcf94 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:48.800934 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-54f9f952-de49-4559-a0b8-3436e89dcf94 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:48.967087 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-54f9f952-de49-4559-a0b8-3436e89dcf94 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:48.975314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-54f9f952-de49-4559-a0b8-3436e89dcf94 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1574 microversion: 2.1 time: 0.187113 May 17 12:12:48.975877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 323/632] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:48 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:49.289925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8fea0c16-ac71-4bdb-a658-ad8f157d8201 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:49.290575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8fea0c16-ac71-4bdb-a658-ad8f157d8201 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:49.296439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8fea0c16-ac71-4bdb-a658-ad8f157d8201 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:49.296888 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8fea0c16-ac71-4bdb-a658-ad8f157d8201 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:49.297657 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8fea0c16-ac71-4bdb-a658-ad8f157d8201 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:49.298089 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8fea0c16-ac71-4bdb-a658-ad8f157d8201 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:49.493789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8fea0c16-ac71-4bdb-a658-ad8f157d8201 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:49.501656 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8fea0c16-ac71-4bdb-a658-ad8f157d8201 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1674 microversion: 2.1 time: 0.216014 May 17 12:12:49.503502 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 310/633] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:49 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1674 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:49.522001 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-085618e2-7df4-4c54-8b14-54e7376229dd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: .version_select at 0x7f2db42b7670>, body: {"keypair": {"name": "tempest-keypair-918379424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGmlUa5fS19hIOsGRJXUMyz+W9Qmt8lASa4pszheJkc91B9mLO1g/MZ13exekRsJJ73IW9pSg58tgUor0AlBM94bZEEgzZiKDzmiguzlBqWzMyruLxWBTTe9mdqe/1eKw=="}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:49.535908 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-085618e2-7df4-4c54-8b14-54e7376229dd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for project 27acd98621cd4a51ac46fb12e1824168. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:12:49.539912 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-085618e2-7df4-4c54-8b14-54e7376229dd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for user 586e15d5d16543e6b70c87fbf9079e9e and project 27acd98621cd4a51ac46fb12e1824168. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:12:49.561250 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-085618e2-7df4-4c54-8b14-54e7376229dd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043114 May 17 12:12:49.561831 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 324/634] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 17 12:12:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:12:49.992354 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b592e5c0-3989-48dd-b7d1-843c18339e80 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:49.992966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b592e5c0-3989-48dd-b7d1-843c18339e80 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:49.999181 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b592e5c0-3989-48dd-b7d1-843c18339e80 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:49.999630 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b592e5c0-3989-48dd-b7d1-843c18339e80 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:50.000420 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b592e5c0-3989-48dd-b7d1-843c18339e80 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:50.000854 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b592e5c0-3989-48dd-b7d1-843c18339e80 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:50.205803 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b592e5c0-3989-48dd-b7d1-843c18339e80 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:50.213330 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b592e5c0-3989-48dd-b7d1-843c18339e80 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1574 microversion: 2.1 time: 0.224931 May 17 12:12:50.213902 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 311/635] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:49 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:50.519608 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7f20bed7-0356-4d96-b6bc-06500d08a6d1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:50.520284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7f20bed7-0356-4d96-b6bc-06500d08a6d1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:50.526290 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7f20bed7-0356-4d96-b6bc-06500d08a6d1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:50.526740 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7f20bed7-0356-4d96-b6bc-06500d08a6d1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:50.527557 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7f20bed7-0356-4d96-b6bc-06500d08a6d1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:50.528253 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7f20bed7-0356-4d96-b6bc-06500d08a6d1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:50.659110 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7f20bed7-0356-4d96-b6bc-06500d08a6d1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:50.666008 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7f20bed7-0356-4d96-b6bc-06500d08a6d1 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1674 microversion: 2.1 time: 0.151034 May 17 12:12:50.666577 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 325/636] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:50 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:50.860214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1280876333", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ff54b2b-d245-42b7-9e38-b4510eee82b9"}], "security_groups": [{"name": "tempest-securitygroup--799154497"}], "key_name": "tempest-keypair-918379424", "user_data": "}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:50.959760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] validate_networks() for [('9ff54b2b-d245-42b7-9e38-b4510eee82b9', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:12:51.230571 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6663ad9d-346b-4ce4-a438-d41844000de0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:51.231217 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6663ad9d-346b-4ce4-a438-d41844000de0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:51.237865 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6663ad9d-346b-4ce4-a438-d41844000de0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:51.238326 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6663ad9d-346b-4ce4-a438-d41844000de0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:51.239098 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6663ad9d-346b-4ce4-a438-d41844000de0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:51.239538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6663ad9d-346b-4ce4-a438-d41844000de0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:51.362965 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:12:51.363449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:12:51.363874 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:12:51.364375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:12:51.364785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:12:51.373235 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:51.373678 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:51.374620 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:51.375056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:51.375405 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6663ad9d-346b-4ce4-a438-d41844000de0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:51.383118 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6663ad9d-346b-4ce4-a438-d41844000de0 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1574 microversion: 2.1 time: 0.156404 May 17 12:12:51.383684 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 326/637] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:51 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:51.391215 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for project 27acd98621cd4a51ac46fb12e1824168. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:12:51.395084 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for user 586e15d5d16543e6b70c87fbf9079e9e and project 27acd98621cd4a51ac46fb12e1824168. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:12:51.405667 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:12:51.407922 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:12:51.454743 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2e83e39b-d0ff-46d0-bf3c-9bf243511137 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.598839 May 17 12:12:51.455424 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 312/638] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:12:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:12:51.465319 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c4d6df08-5665-4201-a201-cd7ae2ad98b5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:51.465932 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c4d6df08-5665-4201-a201-cd7ae2ad98b5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:51.517179 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c4d6df08-5665-4201-a201-cd7ae2ad98b5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:51.524965 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c4d6df08-5665-4201-a201-cd7ae2ad98b5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1241 microversion: 2.1 time: 0.063353 May 17 12:12:51.535082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 327/639] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:51 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:51.683147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c908ce39-ac67-4bf7-aaa9-28e19aacffab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:51.683769 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c908ce39-ac67-4bf7-aaa9-28e19aacffab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:51.690474 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c908ce39-ac67-4bf7-aaa9-28e19aacffab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:51.690922 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c908ce39-ac67-4bf7-aaa9-28e19aacffab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:51.691924 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c908ce39-ac67-4bf7-aaa9-28e19aacffab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:51.692559 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c908ce39-ac67-4bf7-aaa9-28e19aacffab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:51.824675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c908ce39-ac67-4bf7-aaa9-28e19aacffab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:51.833919 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c908ce39-ac67-4bf7-aaa9-28e19aacffab tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1674 microversion: 2.1 time: 0.154745 May 17 12:12:51.834527 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 313/640] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:51 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:52.400350 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-07053135-48f2-4093-8282-1e7b7415f59a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:52.400960 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-07053135-48f2-4093-8282-1e7b7415f59a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:52.407581 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-07053135-48f2-4093-8282-1e7b7415f59a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:52.408025 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-07053135-48f2-4093-8282-1e7b7415f59a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:52.408815 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-07053135-48f2-4093-8282-1e7b7415f59a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:52.409932 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-07053135-48f2-4093-8282-1e7b7415f59a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:52.537235 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-07053135-48f2-4093-8282-1e7b7415f59a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:52.542850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6928156e-746a-4645-989e-5f38a26eb6e0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:52.543471 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6928156e-746a-4645-989e-5f38a26eb6e0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:52.545961 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-07053135-48f2-4093-8282-1e7b7415f59a tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1574 microversion: 2.1 time: 0.149399 May 17 12:12:52.546538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 328/641] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:52 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:52.551595 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6928156e-746a-4645-989e-5f38a26eb6e0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:52.552059 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6928156e-746a-4645-989e-5f38a26eb6e0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:52.552871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6928156e-746a-4645-989e-5f38a26eb6e0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:52.553313 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6928156e-746a-4645-989e-5f38a26eb6e0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:52.616845 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-6928156e-746a-4645-989e-5f38a26eb6e0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:52.624041 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6928156e-746a-4645-989e-5f38a26eb6e0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1293 microversion: 2.1 time: 0.085427 May 17 12:12:52.624635 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 314/642] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:52 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:52.851247 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ce7588f9-2622-4ac2-badd-eda88abf4db8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:52.851773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ce7588f9-2622-4ac2-badd-eda88abf4db8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:52.857675 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce7588f9-2622-4ac2-badd-eda88abf4db8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:52.858124 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce7588f9-2622-4ac2-badd-eda88abf4db8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:52.858878 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce7588f9-2622-4ac2-badd-eda88abf4db8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:52.859311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ce7588f9-2622-4ac2-badd-eda88abf4db8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:52.988458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ce7588f9-2622-4ac2-badd-eda88abf4db8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:52.995691 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ce7588f9-2622-4ac2-badd-eda88abf4db8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1674 microversion: 2.1 time: 0.148591 May 17 12:12:52.996282 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 329/643] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:52 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:53.562851 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c71dfbc8-f5c8-42ec-8931-cf2e495c78cb tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:53.563461 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c71dfbc8-f5c8-42ec-8931-cf2e495c78cb tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:53.570009 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c71dfbc8-f5c8-42ec-8931-cf2e495c78cb tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:53.570451 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c71dfbc8-f5c8-42ec-8931-cf2e495c78cb tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:53.571206 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c71dfbc8-f5c8-42ec-8931-cf2e495c78cb tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:53.571637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c71dfbc8-f5c8-42ec-8931-cf2e495c78cb tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:53.641864 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-dbcfa0c6-b024-46f5-9c32-d28676dea4b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:53.642479 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-dbcfa0c6-b024-46f5-9c32-d28676dea4b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:53.648922 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbcfa0c6-b024-46f5-9c32-d28676dea4b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:53.649375 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbcfa0c6-b024-46f5-9c32-d28676dea4b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:53.650147 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbcfa0c6-b024-46f5-9c32-d28676dea4b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:53.650587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbcfa0c6-b024-46f5-9c32-d28676dea4b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:53.706690 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c71dfbc8-f5c8-42ec-8931-cf2e495c78cb tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:53.712049 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-dbcfa0c6-b024-46f5-9c32-d28676dea4b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:53.714419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c71dfbc8-f5c8-42ec-8931-cf2e495c78cb tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1574 microversion: 2.1 time: 0.155390 May 17 12:12:53.715195 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 315/644] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:53 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:53.721846 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-dbcfa0c6-b024-46f5-9c32-d28676dea4b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1301 microversion: 2.1 time: 0.083472 May 17 12:12:53.722809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 330/645] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:53 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:54.013319 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c84ca515-13ff-47c9-9d45-5b036a291980 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:54.014037 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c84ca515-13ff-47c9-9d45-5b036a291980 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:54.020477 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c84ca515-13ff-47c9-9d45-5b036a291980 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.021030 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c84ca515-13ff-47c9-9d45-5b036a291980 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.021812 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c84ca515-13ff-47c9-9d45-5b036a291980 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.022251 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c84ca515-13ff-47c9-9d45-5b036a291980 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.157154 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c84ca515-13ff-47c9-9d45-5b036a291980 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:54.164454 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c84ca515-13ff-47c9-9d45-5b036a291980 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1674 microversion: 2.1 time: 0.155118 May 17 12:12:54.165023 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 316/646] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:54 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:54.213955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9e9698b6-3f07-47e7-b867-ee4347eaa2b0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:54.213955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9e9698b6-3f07-47e7-b867-ee4347eaa2b0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:54.222857 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9e9698b6-3f07-47e7-b867-ee4347eaa2b0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.223311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9e9698b6-3f07-47e7-b867-ee4347eaa2b0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.224094 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9e9698b6-3f07-47e7-b867-ee4347eaa2b0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.224562 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9e9698b6-3f07-47e7-b867-ee4347eaa2b0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.256668 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9e9698b6-3f07-47e7-b867-ee4347eaa2b0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments/d70569f8-0bd0-46a3-936d-3114ef0936a4" status: 200 len: 194 microversion: 2.20 time: 0.047975 May 17 12:12:54.257379 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 331/647] 10.222.0.58 () {60 vars in 1453 bytes} [Tue May 17 12:12:54 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments/d70569f8-0bd0-46a3-936d-3114ef0936a4 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 12:12:54.319456 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8ce2486a-beb4-4b6c-9189-9991f8c00557 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:54.319983 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8ce2486a-beb4-4b6c-9189-9991f8c00557 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:54.326191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ce2486a-beb4-4b6c-9189-9991f8c00557 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.326645 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ce2486a-beb4-4b6c-9189-9991f8c00557 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.327413 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ce2486a-beb4-4b6c-9189-9991f8c00557 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.327851 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ce2486a-beb4-4b6c-9189-9991f8c00557 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.411398 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-8ce2486a-beb4-4b6c-9189-9991f8c00557 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lazy-loading 'services' on Instance uuid d883f923-082e-4ee1-ba3e-0975ba2d7409 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:12:54.488801 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8ce2486a-beb4-4b6c-9189-9991f8c00557 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments/d70569f8-0bd0-46a3-936d-3114ef0936a4" status: 202 len: 0 microversion: 2.20 time: 0.173263 May 17 12:12:54.489933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 317/648] 10.222.0.58 () {60 vars in 1456 bytes} [Tue May 17 12:12:54 2022] DELETE /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments/d70569f8-0bd0-46a3-936d-3114ef0936a4 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 12:12:54.498695 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-06b309ed-0a3d-45be-aa6b-4fc8d4040496 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:54.499820 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-06b309ed-0a3d-45be-aa6b-4fc8d4040496 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:54.507010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-06b309ed-0a3d-45be-aa6b-4fc8d4040496 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.507905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-06b309ed-0a3d-45be-aa6b-4fc8d4040496 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.508725 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-06b309ed-0a3d-45be-aa6b-4fc8d4040496 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.509194 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-06b309ed-0a3d-45be-aa6b-4fc8d4040496 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.543070 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-06b309ed-0a3d-45be-aa6b-4fc8d4040496 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048484 May 17 12:12:54.543970 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 332/649] 10.222.0.58 () {60 vars in 1342 bytes} [Tue May 17 12:12:54 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 12:12:54.733259 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3ff9a175-a247-4709-85cb-07f45f79d6f4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:54.734006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-3ff9a175-a247-4709-85cb-07f45f79d6f4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:54.739420 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d2952d94-7cf3-402b-93cf-f2fb41cfe2a6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:54.740034 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d2952d94-7cf3-402b-93cf-f2fb41cfe2a6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:54.741985 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3ff9a175-a247-4709-85cb-07f45f79d6f4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.742450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3ff9a175-a247-4709-85cb-07f45f79d6f4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.743229 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3ff9a175-a247-4709-85cb-07f45f79d6f4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.743827 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3ff9a175-a247-4709-85cb-07f45f79d6f4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.746268 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2952d94-7cf3-402b-93cf-f2fb41cfe2a6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.746710 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2952d94-7cf3-402b-93cf-f2fb41cfe2a6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.747587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2952d94-7cf3-402b-93cf-f2fb41cfe2a6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:54.748034 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2952d94-7cf3-402b-93cf-f2fb41cfe2a6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:54.808767 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d2952d94-7cf3-402b-93cf-f2fb41cfe2a6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:54.816527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d2952d94-7cf3-402b-93cf-f2fb41cfe2a6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1299 microversion: 2.1 time: 0.081457 May 17 12:12:54.817159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 333/650] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:54 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:54.877204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3ff9a175-a247-4709-85cb-07f45f79d6f4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:54.885219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-3ff9a175-a247-4709-85cb-07f45f79d6f4 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1574 microversion: 2.1 time: 0.156821 May 17 12:12:54.885788 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 318/651] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:54 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:55.181621 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4bb565b1-42ab-4910-8462-2aa088b0cd83 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:55.182236 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4bb565b1-42ab-4910-8462-2aa088b0cd83 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:55.188011 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4bb565b1-42ab-4910-8462-2aa088b0cd83 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.188497 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4bb565b1-42ab-4910-8462-2aa088b0cd83 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.189267 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4bb565b1-42ab-4910-8462-2aa088b0cd83 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.189727 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4bb565b1-42ab-4910-8462-2aa088b0cd83 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.405240 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4bb565b1-42ab-4910-8462-2aa088b0cd83 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:55.412543 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4bb565b1-42ab-4910-8462-2aa088b0cd83 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1651 microversion: 2.1 time: 0.234699 May 17 12:12:55.413122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 334/652] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:55 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1651 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:55.431610 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-76c43bfe-4725-4724-aa8c-f2131225faca tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:55.437789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76c43bfe-4725-4724-aa8c-f2131225faca tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.438245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76c43bfe-4725-4724-aa8c-f2131225faca tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.461724 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-76c43bfe-4725-4724-aa8c-f2131225faca tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Going to try to start instance {{(pid=117113) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 12:12:55.509534 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-76c43bfe-4725-4724-aa8c-f2131225faca tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/action" status: 202 len: 0 microversion: 2.1 time: 0.082955 May 17 12:12:55.510427 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 319/653] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:12:55 2022] POST /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:12:55.518449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3840a1ce-4aca-4ad2-8620-502055c471b3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:55.519065 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3840a1ce-4aca-4ad2-8620-502055c471b3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:55.528955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3840a1ce-4aca-4ad2-8620-502055c471b3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.529413 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3840a1ce-4aca-4ad2-8620-502055c471b3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.530411 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3840a1ce-4aca-4ad2-8620-502055c471b3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.531233 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3840a1ce-4aca-4ad2-8620-502055c471b3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.556836 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-16c2d7a4-6a13-4186-8076-fab5cae28c95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:55.558307 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-16c2d7a4-6a13-4186-8076-fab5cae28c95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:55.565045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-16c2d7a4-6a13-4186-8076-fab5cae28c95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.566129 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-16c2d7a4-6a13-4186-8076-fab5cae28c95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.567001 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-16c2d7a4-6a13-4186-8076-fab5cae28c95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.567509 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-16c2d7a4-6a13-4186-8076-fab5cae28c95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.601986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-16c2d7a4-6a13-4186-8076-fab5cae28c95 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050493 May 17 12:12:55.602887 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 320/654] 10.222.0.58 () {60 vars in 1342 bytes} [Tue May 17 12:12:55 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 12:12:55.679941 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3840a1ce-4aca-4ad2-8620-502055c471b3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:55.687246 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3840a1ce-4aca-4ad2-8620-502055c471b3 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1660 microversion: 2.1 time: 0.172700 May 17 12:12:55.687816 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 335/655] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:55 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1660 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:55.833783 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-04c7bb45-f2fb-479e-a205-fb74948bb222 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:55.834315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-04c7bb45-f2fb-479e-a205-fb74948bb222 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:55.840653 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-04c7bb45-f2fb-479e-a205-fb74948bb222 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.841098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-04c7bb45-f2fb-479e-a205-fb74948bb222 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.841866 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-04c7bb45-f2fb-479e-a205-fb74948bb222 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.842297 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-04c7bb45-f2fb-479e-a205-fb74948bb222 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.901918 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-adb12852-be59-4e95-90bf-f23966aae0e2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:55.903209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-adb12852-be59-4e95-90bf-f23966aae0e2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:55.911801 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-adb12852-be59-4e95-90bf-f23966aae0e2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.912476 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-adb12852-be59-4e95-90bf-f23966aae0e2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.913406 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-adb12852-be59-4e95-90bf-f23966aae0e2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:55.913998 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-adb12852-be59-4e95-90bf-f23966aae0e2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:55.976351 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-04c7bb45-f2fb-479e-a205-fb74948bb222 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:55.983828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-04c7bb45-f2fb-479e-a205-fb74948bb222 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.153931 May 17 12:12:55.984453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 321/656] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:55 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:56.080635 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-adb12852-be59-4e95-90bf-f23966aae0e2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:56.089067 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-adb12852-be59-4e95-90bf-f23966aae0e2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1574 microversion: 2.1 time: 0.190878 May 17 12:12:56.089583 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 336/657] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:55 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:56.613486 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-48ffab44-30ba-49e8-8e85-0843b78060ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:56.614519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-48ffab44-30ba-49e8-8e85-0843b78060ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:56.622288 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-48ffab44-30ba-49e8-8e85-0843b78060ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:56.622743 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-48ffab44-30ba-49e8-8e85-0843b78060ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:56.623535 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-48ffab44-30ba-49e8-8e85-0843b78060ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:56.623971 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-48ffab44-30ba-49e8-8e85-0843b78060ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:56.661008 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-48ffab44-30ba-49e8-8e85-0843b78060ce tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051611 May 17 12:12:56.661589 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 322/658] 10.222.0.58 () {60 vars in 1342 bytes} [Tue May 17 12:12:56 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 12:12:56.716435 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-dcebd7ba-42d4-4ad7-92ad-7dd94dc92c62 req-9ec6ed0b-dbc0-47be-88f8-e2d4fe48b757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58ca2e7-3e3c-4fa8-a58c-214808748479", "tag": "ee78d37c-d82b-4318-894a-ba9b46ce8870"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:56.719395 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-20416504-79ba-4e6e-bb0c-54b1e7289730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:56.720036 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-20416504-79ba-4e6e-bb0c-54b1e7289730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:56.732619 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20416504-79ba-4e6e-bb0c-54b1e7289730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:56.733254 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20416504-79ba-4e6e-bb0c-54b1e7289730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:56.734050 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20416504-79ba-4e6e-bb0c-54b1e7289730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:56.735198 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20416504-79ba-4e6e-bb0c-54b1e7289730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:56.739682 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-dcebd7ba-42d4-4ad7-92ad-7dd94dc92c62 req-9ec6ed0b-dbc0-47be-88f8-e2d4fe48b757 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:56.740223 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-dcebd7ba-42d4-4ad7-92ad-7dd94dc92c62 req-9ec6ed0b-dbc0-47be-88f8-e2d4fe48b757 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:56.760725 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-dcebd7ba-42d4-4ad7-92ad-7dd94dc92c62 req-9ec6ed0b-dbc0-47be-88f8-e2d4fe48b757 service nova] Creating event network-changed:ee78d37c-d82b-4318-894a-ba9b46ce8870 for instance e58ca2e7-3e3c-4fa8-a58c-214808748479 on hv-cinder-83769 May 17 12:12:56.782133 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-dcebd7ba-42d4-4ad7-92ad-7dd94dc92c62 req-9ec6ed0b-dbc0-47be-88f8-e2d4fe48b757 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076149 May 17 12:12:56.783483 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 323/659] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:12:56.901171 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-20416504-79ba-4e6e-bb0c-54b1e7289730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:56.909549 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-20416504-79ba-4e6e-bb0c-54b1e7289730 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1660 microversion: 2.1 time: 0.208672 May 17 12:12:56.916245 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 337/660] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:56 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1660 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:57.001561 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a7586cb3-5001-454e-9fea-b77c81d0f18c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:57.002260 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a7586cb3-5001-454e-9fea-b77c81d0f18c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:57.009156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7586cb3-5001-454e-9fea-b77c81d0f18c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.009609 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7586cb3-5001-454e-9fea-b77c81d0f18c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.010375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7586cb3-5001-454e-9fea-b77c81d0f18c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.010883 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7586cb3-5001-454e-9fea-b77c81d0f18c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.106909 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1b8ea88e-7e84-4cb2-b98a-77ea87fb1ccd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:57.107839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1b8ea88e-7e84-4cb2-b98a-77ea87fb1ccd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:57.114779 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1b8ea88e-7e84-4cb2-b98a-77ea87fb1ccd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.115220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1b8ea88e-7e84-4cb2-b98a-77ea87fb1ccd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.116662 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1b8ea88e-7e84-4cb2-b98a-77ea87fb1ccd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.117099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1b8ea88e-7e84-4cb2-b98a-77ea87fb1ccd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.236623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a7586cb3-5001-454e-9fea-b77c81d0f18c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:57.245982 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a7586cb3-5001-454e-9fea-b77c81d0f18c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.249007 May 17 12:12:57.246731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 324/661] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:56 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:57.395277 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1b8ea88e-7e84-4cb2-b98a-77ea87fb1ccd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:57.404686 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1b8ea88e-7e84-4cb2-b98a-77ea87fb1ccd tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1561 microversion: 2.1 time: 0.301589 May 17 12:12:57.405424 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 338/662] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:57 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1561 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:57.672896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8ee77d5a-03ce-4c55-89f1-c81c2a4aacb4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:57.674160 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8ee77d5a-03ce-4c55-89f1-c81c2a4aacb4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:57.681120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ee77d5a-03ce-4c55-89f1-c81c2a4aacb4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.681656 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ee77d5a-03ce-4c55-89f1-c81c2a4aacb4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.682611 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ee77d5a-03ce-4c55-89f1-c81c2a4aacb4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.683153 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8ee77d5a-03ce-4c55-89f1-c81c2a4aacb4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.713143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8ee77d5a-03ce-4c55-89f1-c81c2a4aacb4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044246 May 17 12:12:57.713771 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 325/663] 10.222.0.58 () {60 vars in 1342 bytes} [Tue May 17 12:12:57 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:57.771380 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6bd68106-adfe-4f26-8139-dc193cb27737 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:57.771921 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6bd68106-adfe-4f26-8139-dc193cb27737 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:57.778099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6bd68106-adfe-4f26-8139-dc193cb27737 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.778554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6bd68106-adfe-4f26-8139-dc193cb27737 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.779333 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6bd68106-adfe-4f26-8139-dc193cb27737 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.779771 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6bd68106-adfe-4f26-8139-dc193cb27737 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.806325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6bd68106-adfe-4f26-8139-dc193cb27737 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:12:57.883255 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6bd68106-adfe-4f26-8139-dc193cb27737 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 204 len: 0 microversion: 2.20 time: 0.116213 May 17 12:12:57.883970 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 339/664] 10.222.0.58 () {60 vars in 1279 bytes} [Tue May 17 12:12:57 2022] DELETE /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 12:12:57.893226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-273af116-3fe8-4fff-96fd-7f96e5dd3a70 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:57.894556 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-273af116-3fe8-4fff-96fd-7f96e5dd3a70 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:57.900935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-273af116-3fe8-4fff-96fd-7f96e5dd3a70 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.901541 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-273af116-3fe8-4fff-96fd-7f96e5dd3a70 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.902332 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-273af116-3fe8-4fff-96fd-7f96e5dd3a70 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.902768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-273af116-3fe8-4fff-96fd-7f96e5dd3a70 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.926859 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-aaca0725-28fa-4758-b52b-8ee70f25d8d6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:57.927550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-aaca0725-28fa-4758-b52b-8ee70f25d8d6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:57.933895 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aaca0725-28fa-4758-b52b-8ee70f25d8d6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.934350 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aaca0725-28fa-4758-b52b-8ee70f25d8d6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:57.935136 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aaca0725-28fa-4758-b52b-8ee70f25d8d6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:57.935577 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aaca0725-28fa-4758-b52b-8ee70f25d8d6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:58.032115 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-273af116-3fe8-4fff-96fd-7f96e5dd3a70 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:58.040353 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-273af116-3fe8-4fff-96fd-7f96e5dd3a70 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:58.042164 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-273af116-3fe8-4fff-96fd-7f96e5dd3a70 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:58.043625 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-273af116-3fe8-4fff-96fd-7f96e5dd3a70 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.154536 May 17 12:12:58.044399 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 326/665] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:12:57 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:12:58.068909 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-aaca0725-28fa-4758-b52b-8ee70f25d8d6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:58.076537 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-aaca0725-28fa-4758-b52b-8ee70f25d8d6 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1660 microversion: 2.1 time: 0.153995 May 17 12:12:58.077082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 340/666] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:57 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1660 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:58.263332 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-af14dc72-d6cd-4ab2-b88c-216419b3683b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:58.263952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-af14dc72-d6cd-4ab2-b88c-216419b3683b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:58.270350 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-af14dc72-d6cd-4ab2-b88c-216419b3683b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:58.270741 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-af14dc72-d6cd-4ab2-b88c-216419b3683b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:58.271508 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-af14dc72-d6cd-4ab2-b88c-216419b3683b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:58.271948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-af14dc72-d6cd-4ab2-b88c-216419b3683b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:58.403961 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-af14dc72-d6cd-4ab2-b88c-216419b3683b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:58.411714 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-af14dc72-d6cd-4ab2-b88c-216419b3683b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.152554 May 17 12:12:58.412319 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 327/667] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:58 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:59.062519 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-39619594-464e-4d1e-b12c-4067d0a70cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:59.063127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-39619594-464e-4d1e-b12c-4067d0a70cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:59.069418 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-39619594-464e-4d1e-b12c-4067d0a70cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:59.069866 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-39619594-464e-4d1e-b12c-4067d0a70cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:59.070623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-39619594-464e-4d1e-b12c-4067d0a70cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:59.071056 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-39619594-464e-4d1e-b12c-4067d0a70cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:59.094095 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-23eac0bf-5b42-4994-9146-2e7997a39c69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:59.094702 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-23eac0bf-5b42-4994-9146-2e7997a39c69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:59.101270 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-23eac0bf-5b42-4994-9146-2e7997a39c69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:59.101752 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-23eac0bf-5b42-4994-9146-2e7997a39c69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:59.102519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-23eac0bf-5b42-4994-9146-2e7997a39c69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:59.102953 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-23eac0bf-5b42-4994-9146-2e7997a39c69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:59.202484 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-39619594-464e-4d1e-b12c-4067d0a70cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:59.211160 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-39619594-464e-4d1e-b12c-4067d0a70cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:59.212876 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-39619594-464e-4d1e-b12c-4067d0a70cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:59.214105 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-39619594-464e-4d1e-b12c-4067d0a70cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.155541 May 17 12:12:59.214690 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 341/668] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:12:59 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:12:59.230391 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-23eac0bf-5b42-4994-9146-2e7997a39c69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:59.237613 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-23eac0bf-5b42-4994-9146-2e7997a39c69 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1664 microversion: 2.1 time: 0.147448 May 17 12:12:59.238175 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 328/669] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:59 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:12:59.429608 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ed32dcb5-92e0-4942-a0c5-cafedd6e0f84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:12:59.430232 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ed32dcb5-92e0-4942-a0c5-cafedd6e0f84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:12:59.436083 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ed32dcb5-92e0-4942-a0c5-cafedd6e0f84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:59.436570 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ed32dcb5-92e0-4942-a0c5-cafedd6e0f84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:59.437350 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ed32dcb5-92e0-4942-a0c5-cafedd6e0f84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:59.437789 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ed32dcb5-92e0-4942-a0c5-cafedd6e0f84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:59.582415 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ed32dcb5-92e0-4942-a0c5-cafedd6e0f84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:12:59.589673 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ed32dcb5-92e0-4942-a0c5-cafedd6e0f84 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.164886 May 17 12:12:59.590242 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 342/670] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:12:59 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:12:59.861025 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-0246be89-290a-414a-b194-1c551d280913 req-ccfcf959-64f2-4b16-8a8d-b5f6f294f309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bf4c33-50e2-4e81-aa3e-98ef857d0628", "name": "network-vif-plugged", "status": "completed", "tag": "ce775399-8aaa-44e2-8bad-de44d822b044"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:12:59.869697 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-0246be89-290a-414a-b194-1c551d280913 req-ccfcf959-64f2-4b16-8a8d-b5f6f294f309 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:12:59.870148 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-0246be89-290a-414a-b194-1c551d280913 req-ccfcf959-64f2-4b16-8a8d-b5f6f294f309 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:12:59.884209 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-0246be89-290a-414a-b194-1c551d280913 req-ccfcf959-64f2-4b16-8a8d-b5f6f294f309 service nova] Creating event network-vif-plugged:ce775399-8aaa-44e2-8bad-de44d822b044 for instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 on hv-cinder-83769 May 17 12:12:59.889623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-0246be89-290a-414a-b194-1c551d280913 req-ccfcf959-64f2-4b16-8a8d-b5f6f294f309 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032151 May 17 12:12:59.890539 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 329/671] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:00.233674 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-92a22379-c377-448b-8a92-4ba0e212d998 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:00.234312 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-92a22379-c377-448b-8a92-4ba0e212d998 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:00.241302 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-92a22379-c377-448b-8a92-4ba0e212d998 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:00.241751 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-92a22379-c377-448b-8a92-4ba0e212d998 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:00.242512 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-92a22379-c377-448b-8a92-4ba0e212d998 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:00.242948 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-92a22379-c377-448b-8a92-4ba0e212d998 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:00.366834 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-92a22379-c377-448b-8a92-4ba0e212d998 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:00.374535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-92a22379-c377-448b-8a92-4ba0e212d998 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:00.376054 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-92a22379-c377-448b-8a92-4ba0e212d998 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:00.377252 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-92a22379-c377-448b-8a92-4ba0e212d998 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.147452 May 17 12:13:00.377824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 343/672] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:00 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:00.607665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ee2cf3fc-267d-4f94-891d-bf0dc1a63f77 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:00.608424 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ee2cf3fc-267d-4f94-891d-bf0dc1a63f77 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:00.614948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ee2cf3fc-267d-4f94-891d-bf0dc1a63f77 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:00.615402 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ee2cf3fc-267d-4f94-891d-bf0dc1a63f77 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:00.616166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ee2cf3fc-267d-4f94-891d-bf0dc1a63f77 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:00.616624 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ee2cf3fc-267d-4f94-891d-bf0dc1a63f77 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:00.745082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ee2cf3fc-267d-4f94-891d-bf0dc1a63f77 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:00.752264 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ee2cf3fc-267d-4f94-891d-bf0dc1a63f77 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.149285 May 17 12:13:00.753035 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 330/673] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:00 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:01.395541 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-47a8dc68-38c3-4f04-80b5-824df4147190 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:01.396148 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-47a8dc68-38c3-4f04-80b5-824df4147190 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:01.402461 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-47a8dc68-38c3-4f04-80b5-824df4147190 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:01.402906 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-47a8dc68-38c3-4f04-80b5-824df4147190 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:01.403667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-47a8dc68-38c3-4f04-80b5-824df4147190 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:01.404104 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-47a8dc68-38c3-4f04-80b5-824df4147190 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:01.533430 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-47a8dc68-38c3-4f04-80b5-824df4147190 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:01.541948 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-47a8dc68-38c3-4f04-80b5-824df4147190 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:01.543436 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-47a8dc68-38c3-4f04-80b5-824df4147190 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:01.544603 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-47a8dc68-38c3-4f04-80b5-824df4147190 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.153656 May 17 12:13:01.545162 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 344/674] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:01 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:01.769939 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ec17511f-a009-42c8-bf6a-faefc238635a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:01.770557 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ec17511f-a009-42c8-bf6a-faefc238635a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:01.776888 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ec17511f-a009-42c8-bf6a-faefc238635a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:01.777341 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ec17511f-a009-42c8-bf6a-faefc238635a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:01.778112 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ec17511f-a009-42c8-bf6a-faefc238635a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:01.778548 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ec17511f-a009-42c8-bf6a-faefc238635a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:01.905111 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ec17511f-a009-42c8-bf6a-faefc238635a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:01.912561 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ec17511f-a009-42c8-bf6a-faefc238635a tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.147176 May 17 12:13:01.913126 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 331/675] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:01 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:02.562660 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e160c6b7-905d-4723-9d1a-b31fddea3440 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:02.563268 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e160c6b7-905d-4723-9d1a-b31fddea3440 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:02.570157 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e160c6b7-905d-4723-9d1a-b31fddea3440 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:02.570600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e160c6b7-905d-4723-9d1a-b31fddea3440 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:02.571361 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e160c6b7-905d-4723-9d1a-b31fddea3440 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:02.571790 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e160c6b7-905d-4723-9d1a-b31fddea3440 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:02.783533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e160c6b7-905d-4723-9d1a-b31fddea3440 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:02.792938 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e160c6b7-905d-4723-9d1a-b31fddea3440 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:02.794473 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e160c6b7-905d-4723-9d1a-b31fddea3440 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:02.795723 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e160c6b7-905d-4723-9d1a-b31fddea3440 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1723 microversion: 2.20 time: 0.236903 May 17 12:13:02.796319 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 345/676] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:02 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:02.929306 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-daaeb8b5-db60-406b-b321-ec0187e40a37 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:02.929914 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-daaeb8b5-db60-406b-b321-ec0187e40a37 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:02.936426 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-daaeb8b5-db60-406b-b321-ec0187e40a37 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:02.936871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-daaeb8b5-db60-406b-b321-ec0187e40a37 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:02.937640 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-daaeb8b5-db60-406b-b321-ec0187e40a37 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:02.938070 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-daaeb8b5-db60-406b-b321-ec0187e40a37 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:03.064300 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-daaeb8b5-db60-406b-b321-ec0187e40a37 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:03.073600 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-daaeb8b5-db60-406b-b321-ec0187e40a37 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.148152 May 17 12:13:03.074195 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 332/677] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:02 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:03.707526 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-ed9b3b8c-888d-4327-8c74-85ec0ffc51d1 req-39f928b8-f890-42d4-ae59-bed81f64b4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d883f923-082e-4ee1-ba3e-0975ba2d7409", "name": "network-vif-deleted", "tag": "cf6ad775-daff-4e4a-b3ee-b4652d53fdfe"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:03.717536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-ed9b3b8c-888d-4327-8c74-85ec0ffc51d1 req-39f928b8-f890-42d4-ae59-bed81f64b4c6 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:03.717981 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-ed9b3b8c-888d-4327-8c74-85ec0ffc51d1 req-39f928b8-f890-42d4-ae59-bed81f64b4c6 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:03.731158 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-ed9b3b8c-888d-4327-8c74-85ec0ffc51d1 req-39f928b8-f890-42d4-ae59-bed81f64b4c6 service nova] Creating event network-vif-deleted:cf6ad775-daff-4e4a-b3ee-b4652d53fdfe for instance d883f923-082e-4ee1-ba3e-0975ba2d7409 on hv-cinder-83769 May 17 12:13:03.738756 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-ed9b3b8c-888d-4327-8c74-85ec0ffc51d1 req-39f928b8-f890-42d4-ae59-bed81f64b4c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033615 May 17 12:13:03.739807 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 346/678] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:03.815637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:03.816994 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:03.824791 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:03.825311 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:03.826753 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:03.827264 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:03.858849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:03.859403 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:03.859948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lazy-loading 'fault' on Instance uuid d883f923-082e-4ee1-ba3e-0975ba2d7409 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:13:03.911664 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:03.919431 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:03.921093 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:03.922251 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ab2cf9da-ba8a-4a02-9ee8-030bacba3288 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 200 len: 1371 microversion: 2.20 time: 0.112166 May 17 12:13:03.922816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 333/679] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:03 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:04.091160 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a5a65830-dada-47c9-b878-4a93104bf921 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:04.092072 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a5a65830-dada-47c9-b878-4a93104bf921 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:04.098761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a5a65830-dada-47c9-b878-4a93104bf921 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:04.099209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a5a65830-dada-47c9-b878-4a93104bf921 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:04.099970 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a5a65830-dada-47c9-b878-4a93104bf921 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:04.100434 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a5a65830-dada-47c9-b878-4a93104bf921 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:04.238974 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a5a65830-dada-47c9-b878-4a93104bf921 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:04.253511 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a5a65830-dada-47c9-b878-4a93104bf921 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.166149 May 17 12:13:04.254209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 347/680] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:04 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:04.941656 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8d457db1-a257-4942-b531-8b6ec9603caf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:04.942275 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8d457db1-a257-4942-b531-8b6ec9603caf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:04.948696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8d457db1-a257-4942-b531-8b6ec9603caf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:04.949204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8d457db1-a257-4942-b531-8b6ec9603caf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:04.950136 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8d457db1-a257-4942-b531-8b6ec9603caf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:04.950656 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8d457db1-a257-4942-b531-8b6ec9603caf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:04.964887 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-8d457db1-a257-4942-b531-8b6ec9603caf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] HTTP exception thrown: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8d457db1-a257-4942-b531-8b6ec9603caf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Request method failure captured: May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 HTTP/1.1 May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_FF35wQCZYa_5R-rm3Al3m8tWE9gPaJAlaRYwQysw1zVZ7iCL1vxXAIpNoKJNNnbSpnGIY0GzbErBufU2yEqLY4BfaskjzAmlvB1bh0uEmgObKIWJAwOb309IlBfJOkqvbDK3B4uJlykOhrz-elL5Fyau25rG-hk7aqNaKhjSSEzs May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Openstack-Nova-Api-Version: 2.20 May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:13:04.966537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cd2c9994923540748c1513406e3e7ffc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}] May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: e8a6a76a94ca4fb197c7b1705b809c54 May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:13:04.968214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'd883f923-082e-4ee1-ba3e-0975ba2d7409'} May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:13:04.969293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:13:04.970575 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:04.972731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8d457db1-a257-4942-b531-8b6ec9603caf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Returning 404 to user: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:13:04.972731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8d457db1-a257-4942-b531-8b6ec9603caf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 404 len: 111 microversion: 2.20 time: 0.030754 May 17 12:13:04.972731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 334/681] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:04 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 12:13:04.977974 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a883bd0d-878f-44ae-a7b7-2978a0bb2da4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '.version_select at 0x7f2db4275af0>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:04.999284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a883bd0d-878f-44ae-a7b7-2978a0bb2da4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031613506" status: 204 len: 0 microversion: 2.20 time: 0.025578 May 17 12:13:05.003503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 348/682] 10.222.0.58 () {60 vars in 1261 bytes} [Tue May 17 12:13:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031613506 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 17 12:13:05.270805 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f8c3105e-c073-43c6-8be9-c3591e35c5a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:05.271710 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f8c3105e-c073-43c6-8be9-c3591e35c5a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:05.277492 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f8c3105e-c073-43c6-8be9-c3591e35c5a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:05.277940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f8c3105e-c073-43c6-8be9-c3591e35c5a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:05.278711 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f8c3105e-c073-43c6-8be9-c3591e35c5a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:05.279143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f8c3105e-c073-43c6-8be9-c3591e35c5a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:05.411043 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f8c3105e-c073-43c6-8be9-c3591e35c5a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:05.420356 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f8c3105e-c073-43c6-8be9-c3591e35c5a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.153432 May 17 12:13:05.421011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 335/683] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:05 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:05.646062 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-83199426-85f6-4cdf-b9f4-5d8c1f06feda tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Action: 'create', calling method: .version_select at 0x7f2db432ad30>, body: {"keypair": {"name": "tempest-keypair-1708215774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcEKFphaIbt6aN98r357GSNzLzzS9jRSREXLfkNbivb2Ax4VTBXUAoG7WAL20LLAnYwYzCOqVdN62PAoO3pHJ9NObjSV18GY0nHyAlcw38itevpnbe+jD1xOamSoQ5RNw=="}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:05.660374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-83199426-85f6-4cdf-b9f4-5d8c1f06feda tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Getting quotas for project cd2c9994923540748c1513406e3e7ffc. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:13:05.664021 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-83199426-85f6-4cdf-b9f4-5d8c1f06feda tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Getting quotas for user e8a6a76a94ca4fb197c7b1705b809c54 and project cd2c9994923540748c1513406e3e7ffc. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:13:05.686751 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-83199426-85f6-4cdf-b9f4-5d8c1f06feda tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044911 May 17 12:13:05.687355 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 349/684] 10.222.0.58 () {62 vars in 1199 bytes} [Tue May 17 12:13:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 12:13:05.894960 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-53f91529-2ff6-48eb-bc29-5cad6b9b0eb2 req-4c7bf56c-b1e2-4003-9884-29b06d43038f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58ca2e7-3e3c-4fa8-a58c-214808748479", "name": "network-vif-plugged", "status": "completed", "tag": "ee78d37c-d82b-4318-894a-ba9b46ce8870"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:05.903566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-53f91529-2ff6-48eb-bc29-5cad6b9b0eb2 req-4c7bf56c-b1e2-4003-9884-29b06d43038f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:05.904275 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-53f91529-2ff6-48eb-bc29-5cad6b9b0eb2 req-4c7bf56c-b1e2-4003-9884-29b06d43038f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:05.918179 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-53f91529-2ff6-48eb-bc29-5cad6b9b0eb2 req-4c7bf56c-b1e2-4003-9884-29b06d43038f service nova] Creating event network-vif-plugged:ee78d37c-d82b-4318-894a-ba9b46ce8870 for instance e58ca2e7-3e3c-4fa8-a58c-214808748479 on hv-cinder-83769 May 17 12:13:05.924205 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-53f91529-2ff6-48eb-bc29-5cad6b9b0eb2 req-4c7bf56c-b1e2-4003-9884-29b06d43038f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 May 17 12:13:05.924989 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 336/685] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:13:06.438936 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cdb8695c-0767-480a-87da-63ebb0180dae tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:06.439558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cdb8695c-0767-480a-87da-63ebb0180dae tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:06.446019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cdb8695c-0767-480a-87da-63ebb0180dae tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:06.446473 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cdb8695c-0767-480a-87da-63ebb0180dae tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:06.447250 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cdb8695c-0767-480a-87da-63ebb0180dae tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:06.447692 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cdb8695c-0767-480a-87da-63ebb0180dae tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:06.586315 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cdb8695c-0767-480a-87da-63ebb0180dae tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:06.593597 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cdb8695c-0767-480a-87da-63ebb0180dae tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.159088 May 17 12:13:06.594192 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 350/686] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:06 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:06.958094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1342255247", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c8419b7-b572-4795-bcd2-a5f8cfb8c6c0"}], "security_groups": [{"name": "tempest-securitygroup--58624623"}], "key_name": "tempest-keypair-1708215774", "user_data": "}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:07.059404 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] validate_networks() for [('5c8419b7-b572-4795-bcd2-a5f8cfb8c6c0', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:13:07.413496 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:13:07.413920 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:13:07.414389 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:13:07.414794 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:13:07.415202 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:13:07.423556 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:07.423999 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:07.424827 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:07.425284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:07.441047 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Getting quotas for project cd2c9994923540748c1513406e3e7ffc. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:13:07.444871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Getting quotas for user e8a6a76a94ca4fb197c7b1705b809c54 and project cd2c9994923540748c1513406e3e7ffc. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:13:07.456129 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:13:07.458742 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:13:07.504946 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1284065a-9411-414f-ac54-0cb065f6a56d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.551971 May 17 12:13:07.505608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 337/687] 10.222.0.58 () {62 vars in 1187 bytes} [Tue May 17 12:13:06 2022] POST /compute/v2.1/servers => generated 400 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 12:13:07.515512 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1e2c3dfc-dae2-43f8-a3f9-953660703581 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:07.516220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1e2c3dfc-dae2-43f8-a3f9-953660703581 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:07.570520 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1e2c3dfc-dae2-43f8-a3f9-953660703581 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:07.578205 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1e2c3dfc-dae2-43f8-a3f9-953660703581 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:07.579700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1e2c3dfc-dae2-43f8-a3f9-953660703581 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:07.581517 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1e2c3dfc-dae2-43f8-a3f9-953660703581 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1282 microversion: 2.20 time: 0.069138 May 17 12:13:07.582219 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 351/688] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:07 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:07.610715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7886f23d-e89e-4c6d-94c0-718c6d271e22 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:07.611333 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7886f23d-e89e-4c6d-94c0-718c6d271e22 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:07.618271 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7886f23d-e89e-4c6d-94c0-718c6d271e22 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:07.618602 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7886f23d-e89e-4c6d-94c0-718c6d271e22 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:07.620385 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7886f23d-e89e-4c6d-94c0-718c6d271e22 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:07.620385 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7886f23d-e89e-4c6d-94c0-718c6d271e22 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:07.750761 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7886f23d-e89e-4c6d-94c0-718c6d271e22 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:07.761202 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7886f23d-e89e-4c6d-94c0-718c6d271e22 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1366 microversion: 2.1 time: 0.154238 May 17 12:13:07.761792 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 338/689] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:07 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:08.599652 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fd86236f-8846-4dd6-a983-8c61df8b0487 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:08.600291 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fd86236f-8846-4dd6-a983-8c61df8b0487 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:08.607288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd86236f-8846-4dd6-a983-8c61df8b0487 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:08.607814 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd86236f-8846-4dd6-a983-8c61df8b0487 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:08.608720 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd86236f-8846-4dd6-a983-8c61df8b0487 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:08.609158 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd86236f-8846-4dd6-a983-8c61df8b0487 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:08.668916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fd86236f-8846-4dd6-a983-8c61df8b0487 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:08.677271 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fd86236f-8846-4dd6-a983-8c61df8b0487 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:08.678766 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fd86236f-8846-4dd6-a983-8c61df8b0487 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:08.679899 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fd86236f-8846-4dd6-a983-8c61df8b0487 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1334 microversion: 2.20 time: 0.084898 May 17 12:13:08.680497 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 352/690] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:08 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1334 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:08.778598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b0d15823-239f-4870-98a5-dd083be89c36 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:08.779214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b0d15823-239f-4870-98a5-dd083be89c36 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:08.786221 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0d15823-239f-4870-98a5-dd083be89c36 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:08.786663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0d15823-239f-4870-98a5-dd083be89c36 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:08.787425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0d15823-239f-4870-98a5-dd083be89c36 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:08.787862 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b0d15823-239f-4870-98a5-dd083be89c36 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:08.926598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b0d15823-239f-4870-98a5-dd083be89c36 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:08.934334 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b0d15823-239f-4870-98a5-dd083be89c36 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1555 microversion: 2.1 time: 0.159536 May 17 12:13:08.934920 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 339/691] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:08 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:08.950734 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c60cd5f3-4087-4a57-95bc-8c480f831ed6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:08.951242 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c60cd5f3-4087-4a57-95bc-8c480f831ed6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:08.958074 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c60cd5f3-4087-4a57-95bc-8c480f831ed6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:08.958531 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c60cd5f3-4087-4a57-95bc-8c480f831ed6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:08.959320 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c60cd5f3-4087-4a57-95bc-8c480f831ed6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:08.959763 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c60cd5f3-4087-4a57-95bc-8c480f831ed6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:09.074222 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c60cd5f3-4087-4a57-95bc-8c480f831ed6 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127544 May 17 12:13:09.074844 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 353/692] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 17 12:13:08 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:09.697615 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-eaa9b422-8894-4814-b4a6-6836ba1ce8e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:09.698604 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-eaa9b422-8894-4814-b4a6-6836ba1ce8e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:09.704903 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eaa9b422-8894-4814-b4a6-6836ba1ce8e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:09.705356 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eaa9b422-8894-4814-b4a6-6836ba1ce8e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:09.706910 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eaa9b422-8894-4814-b4a6-6836ba1ce8e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:09.707352 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eaa9b422-8894-4814-b4a6-6836ba1ce8e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:09.951676 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-eaa9b422-8894-4814-b4a6-6836ba1ce8e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:09.970598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-eaa9b422-8894-4814-b4a6-6836ba1ce8e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:09.978280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-eaa9b422-8894-4814-b4a6-6836ba1ce8e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:09.981548 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-eaa9b422-8894-4814-b4a6-6836ba1ce8e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1406 microversion: 2.20 time: 0.285935 May 17 12:13:09.982330 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 340/693] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:09 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:10.363125 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-3fd87fb4-7fa7-4a24-84b5-69769135b68f req-0bda6d79-91d5-4a40-a171-e22bb70e98e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58ca2e7-3e3c-4fa8-a58c-214808748479", "tag": "ee78d37c-d82b-4318-894a-ba9b46ce8870"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:10.371210 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-3fd87fb4-7fa7-4a24-84b5-69769135b68f req-0bda6d79-91d5-4a40-a171-e22bb70e98e1 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:10.371850 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-3fd87fb4-7fa7-4a24-84b5-69769135b68f req-0bda6d79-91d5-4a40-a171-e22bb70e98e1 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:10.390515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-3fd87fb4-7fa7-4a24-84b5-69769135b68f req-0bda6d79-91d5-4a40-a171-e22bb70e98e1 service nova] Creating event network-changed:ee78d37c-d82b-4318-894a-ba9b46ce8870 for instance e58ca2e7-3e3c-4fa8-a58c-214808748479 on hv-cinder-83769 May 17 12:13:10.400540 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-3fd87fb4-7fa7-4a24-84b5-69769135b68f req-0bda6d79-91d5-4a40-a171-e22bb70e98e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041269 May 17 12:13:10.405125 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 354/694] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:10.520622 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-d7b2e0ab-2c7a-4d60-a9ae-d5adaacb7e6f req-facc76d3-7924-4832-a42a-a00cdbcf9524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23", "tag": "3370c5ba-e7d7-4dab-8520-7a3da90d8b4a"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:10.534185 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-d7b2e0ab-2c7a-4d60-a9ae-d5adaacb7e6f req-facc76d3-7924-4832-a42a-a00cdbcf9524 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:10.534858 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-d7b2e0ab-2c7a-4d60-a9ae-d5adaacb7e6f req-facc76d3-7924-4832-a42a-a00cdbcf9524 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:10.549983 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-d7b2e0ab-2c7a-4d60-a9ae-d5adaacb7e6f req-facc76d3-7924-4832-a42a-a00cdbcf9524 service nova] Creating event network-changed:3370c5ba-e7d7-4dab-8520-7a3da90d8b4a for instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 on hv-cinder-83769 May 17 12:13:10.555034 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-d7b2e0ab-2c7a-4d60-a9ae-d5adaacb7e6f req-facc76d3-7924-4832-a42a-a00cdbcf9524 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040413 May 17 12:13:10.556048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 341/695] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:11.002365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d7e5a461-59f3-40f1-a66f-8130733fb790 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:11.004234 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d7e5a461-59f3-40f1-a66f-8130733fb790 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:11.010816 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d7e5a461-59f3-40f1-a66f-8130733fb790 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:11.011365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d7e5a461-59f3-40f1-a66f-8130733fb790 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:11.012278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d7e5a461-59f3-40f1-a66f-8130733fb790 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:11.012979 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d7e5a461-59f3-40f1-a66f-8130733fb790 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:11.255960 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d7e5a461-59f3-40f1-a66f-8130733fb790 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:11.264529 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d7e5a461-59f3-40f1-a66f-8130733fb790 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:11.266037 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d7e5a461-59f3-40f1-a66f-8130733fb790 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:11.267145 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d7e5a461-59f3-40f1-a66f-8130733fb790 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1406 microversion: 2.20 time: 0.269998 May 17 12:13:11.267710 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 355/696] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:10 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:12.285487 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8bbeade9-cc53-4bed-a15a-3ed08613f9cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:12.286195 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8bbeade9-cc53-4bed-a15a-3ed08613f9cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:12.292369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bbeade9-cc53-4bed-a15a-3ed08613f9cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:12.292828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bbeade9-cc53-4bed-a15a-3ed08613f9cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:12.293600 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bbeade9-cc53-4bed-a15a-3ed08613f9cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:12.294043 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bbeade9-cc53-4bed-a15a-3ed08613f9cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:12.421973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8bbeade9-cc53-4bed-a15a-3ed08613f9cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:12.429833 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8bbeade9-cc53-4bed-a15a-3ed08613f9cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:12.431348 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8bbeade9-cc53-4bed-a15a-3ed08613f9cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:12.432497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8bbeade9-cc53-4bed-a15a-3ed08613f9cb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1406 microversion: 2.20 time: 0.151703 May 17 12:13:12.433068 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 342/697] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:12 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:13.451173 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-acf0f60d-d60a-4fec-8c26-4f4bdb90c358 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:13.451784 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-acf0f60d-d60a-4fec-8c26-4f4bdb90c358 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:13.458299 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-acf0f60d-d60a-4fec-8c26-4f4bdb90c358 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:13.458748 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-acf0f60d-d60a-4fec-8c26-4f4bdb90c358 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:13.459515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-acf0f60d-d60a-4fec-8c26-4f4bdb90c358 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:13.459959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-acf0f60d-d60a-4fec-8c26-4f4bdb90c358 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:13.589228 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-acf0f60d-d60a-4fec-8c26-4f4bdb90c358 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:13.597386 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-acf0f60d-d60a-4fec-8c26-4f4bdb90c358 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:13.598877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-acf0f60d-d60a-4fec-8c26-4f4bdb90c358 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:13.599971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-acf0f60d-d60a-4fec-8c26-4f4bdb90c358 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1406 microversion: 2.20 time: 0.153125 May 17 12:13:13.600578 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 356/698] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:13 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:14.617837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2fd55c9a-86a6-439b-b395-8bd375f5f117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:14.618474 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2fd55c9a-86a6-439b-b395-8bd375f5f117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:14.624726 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2fd55c9a-86a6-439b-b395-8bd375f5f117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:14.625172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2fd55c9a-86a6-439b-b395-8bd375f5f117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:14.625937 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2fd55c9a-86a6-439b-b395-8bd375f5f117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:14.626373 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2fd55c9a-86a6-439b-b395-8bd375f5f117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:14.752835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2fd55c9a-86a6-439b-b395-8bd375f5f117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:14.760504 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2fd55c9a-86a6-439b-b395-8bd375f5f117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:14.762038 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2fd55c9a-86a6-439b-b395-8bd375f5f117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:14.763141 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2fd55c9a-86a6-439b-b395-8bd375f5f117 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1406 microversion: 2.20 time: 0.149233 May 17 12:13:14.763716 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 343/699] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:14 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:15.781760 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6a51181d-1f93-4cf1-ac85-5841eca2549c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:15.782303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6a51181d-1f93-4cf1-ac85-5841eca2549c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:15.788579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6a51181d-1f93-4cf1-ac85-5841eca2549c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:15.789022 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6a51181d-1f93-4cf1-ac85-5841eca2549c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:15.789789 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6a51181d-1f93-4cf1-ac85-5841eca2549c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:15.790421 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6a51181d-1f93-4cf1-ac85-5841eca2549c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:15.918169 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6a51181d-1f93-4cf1-ac85-5841eca2549c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:15.926554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6a51181d-1f93-4cf1-ac85-5841eca2549c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:15.928104 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6a51181d-1f93-4cf1-ac85-5841eca2549c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:15.929305 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6a51181d-1f93-4cf1-ac85-5841eca2549c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1406 microversion: 2.20 time: 0.151505 May 17 12:13:15.929874 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 357/700] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:15 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:16.946045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c02b8ea3-d00c-4d6b-8f82-4a5da906adcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:16.946655 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c02b8ea3-d00c-4d6b-8f82-4a5da906adcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:16.953212 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c02b8ea3-d00c-4d6b-8f82-4a5da906adcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:16.953662 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c02b8ea3-d00c-4d6b-8f82-4a5da906adcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:16.954416 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c02b8ea3-d00c-4d6b-8f82-4a5da906adcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:16.954846 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c02b8ea3-d00c-4d6b-8f82-4a5da906adcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:17.083128 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c02b8ea3-d00c-4d6b-8f82-4a5da906adcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:17.091002 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c02b8ea3-d00c-4d6b-8f82-4a5da906adcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:17.092529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c02b8ea3-d00c-4d6b-8f82-4a5da906adcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:17.093671 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c02b8ea3-d00c-4d6b-8f82-4a5da906adcd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1406 microversion: 2.20 time: 0.151466 May 17 12:13:17.094245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 344/701] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:16 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:17.936063 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-078a6bec-6c2f-43d1-a730-6b58872ad5fd req-4a2004fe-7c3c-4b96-aa51-dfa0faf4f3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23", "name": "network-vif-plugged", "status": "completed", "tag": "3370c5ba-e7d7-4dab-8520-7a3da90d8b4a"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:17.945580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-078a6bec-6c2f-43d1-a730-6b58872ad5fd req-4a2004fe-7c3c-4b96-aa51-dfa0faf4f3b3 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:17.946022 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-078a6bec-6c2f-43d1-a730-6b58872ad5fd req-4a2004fe-7c3c-4b96-aa51-dfa0faf4f3b3 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:17.958746 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-078a6bec-6c2f-43d1-a730-6b58872ad5fd req-4a2004fe-7c3c-4b96-aa51-dfa0faf4f3b3 service nova] Creating event network-vif-plugged:3370c5ba-e7d7-4dab-8520-7a3da90d8b4a for instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 on hv-cinder-83769 May 17 12:13:17.964248 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-078a6bec-6c2f-43d1-a730-6b58872ad5fd req-4a2004fe-7c3c-4b96-aa51-dfa0faf4f3b3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031743 May 17 12:13:17.964899 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 358/702] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:13:18.114469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-604fa674-59cb-4458-a9af-57e9094629e0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:18.115122 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-604fa674-59cb-4458-a9af-57e9094629e0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:18.121519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-604fa674-59cb-4458-a9af-57e9094629e0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:18.121767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-604fa674-59cb-4458-a9af-57e9094629e0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:18.122610 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-604fa674-59cb-4458-a9af-57e9094629e0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:18.123075 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-604fa674-59cb-4458-a9af-57e9094629e0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:18.255940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-604fa674-59cb-4458-a9af-57e9094629e0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:18.263585 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-604fa674-59cb-4458-a9af-57e9094629e0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:18.265137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-604fa674-59cb-4458-a9af-57e9094629e0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:18.266233 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-604fa674-59cb-4458-a9af-57e9094629e0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1406 microversion: 2.20 time: 0.157434 May 17 12:13:18.266804 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 345/703] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:18 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:19.285292 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-90c23cf8-8480-4d07-8fcc-e41cfd2221b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:19.285981 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-90c23cf8-8480-4d07-8fcc-e41cfd2221b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:19.292511 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90c23cf8-8480-4d07-8fcc-e41cfd2221b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:19.292966 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90c23cf8-8480-4d07-8fcc-e41cfd2221b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:19.293744 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90c23cf8-8480-4d07-8fcc-e41cfd2221b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:19.294185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90c23cf8-8480-4d07-8fcc-e41cfd2221b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:19.424515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-90c23cf8-8480-4d07-8fcc-e41cfd2221b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:19.432245 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-90c23cf8-8480-4d07-8fcc-e41cfd2221b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:19.433744 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-90c23cf8-8480-4d07-8fcc-e41cfd2221b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:19.434830 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-90c23cf8-8480-4d07-8fcc-e41cfd2221b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1406 microversion: 2.20 time: 0.154447 May 17 12:13:19.435394 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 359/704] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:19 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:20.452708 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-09c0ac4c-a7e2-4668-992a-2fcd1fb0e7de tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:20.453364 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-09c0ac4c-a7e2-4668-992a-2fcd1fb0e7de tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:20.460454 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-09c0ac4c-a7e2-4668-992a-2fcd1fb0e7de tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:20.460912 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-09c0ac4c-a7e2-4668-992a-2fcd1fb0e7de tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:20.461702 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-09c0ac4c-a7e2-4668-992a-2fcd1fb0e7de tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:20.462154 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-09c0ac4c-a7e2-4668-992a-2fcd1fb0e7de tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:20.593344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-09c0ac4c-a7e2-4668-992a-2fcd1fb0e7de tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:20.601153 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-09c0ac4c-a7e2-4668-992a-2fcd1fb0e7de tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:20.602664 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-09c0ac4c-a7e2-4668-992a-2fcd1fb0e7de tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:20.603903 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-09c0ac4c-a7e2-4668-992a-2fcd1fb0e7de tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1406 microversion: 2.20 time: 0.155201 May 17 12:13:20.604507 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 346/705] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:20 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:21.621504 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fd64246d-9340-442e-a00e-e27724c2065d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:21.622122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fd64246d-9340-442e-a00e-e27724c2065d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:21.628530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd64246d-9340-442e-a00e-e27724c2065d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:21.628982 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd64246d-9340-442e-a00e-e27724c2065d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:21.629751 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd64246d-9340-442e-a00e-e27724c2065d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:21.630197 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fd64246d-9340-442e-a00e-e27724c2065d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:21.756883 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fd64246d-9340-442e-a00e-e27724c2065d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:21.764549 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fd64246d-9340-442e-a00e-e27724c2065d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:21.766057 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fd64246d-9340-442e-a00e-e27724c2065d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:21.767213 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fd64246d-9340-442e-a00e-e27724c2065d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1597 microversion: 2.20 time: 0.149689 May 17 12:13:21.768328 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 360/706] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:13:21 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1597 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:13:21.785321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-80f79ee4-6ce3-4c7b-8919-b28726ea6569 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:21.785810 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-80f79ee4-6ce3-4c7b-8919-b28726ea6569 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:21.791990 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80f79ee4-6ce3-4c7b-8919-b28726ea6569 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:21.792463 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80f79ee4-6ce3-4c7b-8919-b28726ea6569 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:21.793225 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80f79ee4-6ce3-4c7b-8919-b28726ea6569 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:21.793655 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80f79ee4-6ce3-4c7b-8919-b28726ea6569 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:21.870436 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-80f79ee4-6ce3-4c7b-8919-b28726ea6569 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089591 May 17 12:13:21.871040 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 347/707] 10.222.0.58 () {60 vars in 1315 bytes} [Tue May 17 12:13:21 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 12:13:22.770637 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-635ea3c4-a8fc-4fb1-a6da-22dba8810bc5 req-e5005582-da6f-4597-939e-c81ab041eaeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23", "tag": "3370c5ba-e7d7-4dab-8520-7a3da90d8b4a"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:22.779142 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-635ea3c4-a8fc-4fb1-a6da-22dba8810bc5 req-e5005582-da6f-4597-939e-c81ab041eaeb service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:22.779346 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-635ea3c4-a8fc-4fb1-a6da-22dba8810bc5 req-e5005582-da6f-4597-939e-c81ab041eaeb service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:22.790589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-635ea3c4-a8fc-4fb1-a6da-22dba8810bc5 req-e5005582-da6f-4597-939e-c81ab041eaeb service nova] Creating event network-changed:3370c5ba-e7d7-4dab-8520-7a3da90d8b4a for instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 on hv-cinder-83769 May 17 12:13:22.795567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-635ea3c4-a8fc-4fb1-a6da-22dba8810bc5 req-e5005582-da6f-4597-939e-c81ab041eaeb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028531 May 17 12:13:22.796365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 361/708] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:23.218697 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-46a3e171-556a-46d0-a96e-7d4fd19af42f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:23.219442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-46a3e171-556a-46d0-a96e-7d4fd19af42f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:23.226531 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-46a3e171-556a-46d0-a96e-7d4fd19af42f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:23.227112 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-46a3e171-556a-46d0-a96e-7d4fd19af42f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:23.227993 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-46a3e171-556a-46d0-a96e-7d4fd19af42f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:23.228561 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-46a3e171-556a-46d0-a96e-7d4fd19af42f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:23.319306 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-46a3e171-556a-46d0-a96e-7d4fd19af42f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lazy-loading 'services' on Instance uuid ce70576a-62fb-4bcc-9163-cfc28131518a {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:13:23.401688 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-46a3e171-556a-46d0-a96e-7d4fd19af42f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments/df795007-e2ba-4c1e-a565-f2d28d4c7182" status: 202 len: 0 microversion: 2.1 time: 0.187254 May 17 12:13:23.402312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 348/709] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:13:23 2022] DELETE /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments/df795007-e2ba-4c1e-a565-f2d28d4c7182 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:13:23.413385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4b04a968-71aa-42f9-b330-ff01fb008140 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:23.414897 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4b04a968-71aa-42f9-b330-ff01fb008140 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:23.421661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4b04a968-71aa-42f9-b330-ff01fb008140 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:23.422311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4b04a968-71aa-42f9-b330-ff01fb008140 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:23.423156 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4b04a968-71aa-42f9-b330-ff01fb008140 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:23.423635 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4b04a968-71aa-42f9-b330-ff01fb008140 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:23.457333 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4b04a968-71aa-42f9-b330-ff01fb008140 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049967 May 17 12:13:23.457926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 362/710] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:13:23 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:24.470192 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-aed8fb51-3db5-4eb4-83d1-68a33d1c75d7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:24.471453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-aed8fb51-3db5-4eb4-83d1-68a33d1c75d7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:24.478338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-aed8fb51-3db5-4eb4-83d1-68a33d1c75d7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:24.478871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-aed8fb51-3db5-4eb4-83d1-68a33d1c75d7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:24.479637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-aed8fb51-3db5-4eb4-83d1-68a33d1c75d7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:24.480356 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-aed8fb51-3db5-4eb4-83d1-68a33d1c75d7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:24.510418 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-aed8fb51-3db5-4eb4-83d1-68a33d1c75d7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 May 17 12:13:24.510991 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 349/711] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:13:24 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:25.524065 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fa523df3-a463-4b97-8112-7af3fb6c10ff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:25.525077 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fa523df3-a463-4b97-8112-7af3fb6c10ff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:25.531607 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa523df3-a463-4b97-8112-7af3fb6c10ff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:25.532057 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa523df3-a463-4b97-8112-7af3fb6c10ff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:25.532892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa523df3-a463-4b97-8112-7af3fb6c10ff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:25.533364 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fa523df3-a463-4b97-8112-7af3fb6c10ff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:25.561767 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fa523df3-a463-4b97-8112-7af3fb6c10ff tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041583 May 17 12:13:25.562319 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 363/712] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:13:25 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 12:13:25.632554 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0019803a-da21-411c-8475-4969f51e199c tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:25.633045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0019803a-da21-411c-8475-4969f51e199c tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:25.639671 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0019803a-da21-411c-8475-4969f51e199c tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:25.640076 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0019803a-da21-411c-8475-4969f51e199c tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:25.640878 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0019803a-da21-411c-8475-4969f51e199c tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:25.641319 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0019803a-da21-411c-8475-4969f51e199c tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:25.665922 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0019803a-da21-411c-8475-4969f51e199c tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Going to try to terminate instance {{(pid=117113) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:13:25.743553 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0019803a-da21-411c-8475-4969f51e199c tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 204 len: 0 microversion: 2.1 time: 0.113572 May 17 12:13:25.744159 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 350/713] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:13:25 2022] DELETE /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:13:25.753407 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-63790cd8-8f8c-47dc-972c-410c1fad0b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:25.754026 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-63790cd8-8f8c-47dc-972c-410c1fad0b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:25.759855 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63790cd8-8f8c-47dc-972c-410c1fad0b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:25.760339 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63790cd8-8f8c-47dc-972c-410c1fad0b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:25.761102 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63790cd8-8f8c-47dc-972c-410c1fad0b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:25.761536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-63790cd8-8f8c-47dc-972c-410c1fad0b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:25.894910 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-63790cd8-8f8c-47dc-972c-410c1fad0b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:25.902398 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-63790cd8-8f8c-47dc-972c-410c1fad0b3f tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1692 microversion: 2.1 time: 0.153980 May 17 12:13:25.902974 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 364/714] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:25 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:26.746363 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:13:26.746921 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Tue May 17 12:13:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:13:26.921638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7043fe4a-a767-4b24-a3cd-3b6e6c00aca2 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:26.922662 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7043fe4a-a767-4b24-a3cd-3b6e6c00aca2 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:26.929405 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7043fe4a-a767-4b24-a3cd-3b6e6c00aca2 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:26.929845 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7043fe4a-a767-4b24-a3cd-3b6e6c00aca2 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:26.930612 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7043fe4a-a767-4b24-a3cd-3b6e6c00aca2 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:26.931046 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7043fe4a-a767-4b24-a3cd-3b6e6c00aca2 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:27.056882 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7043fe4a-a767-4b24-a3cd-3b6e6c00aca2 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:27.064106 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7043fe4a-a767-4b24-a3cd-3b6e6c00aca2 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1692 microversion: 2.1 time: 0.148277 May 17 12:13:27.064706 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 351/715] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:26 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1692 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:28.081795 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-110670f3-d2b4-488a-b13b-22426235fd66 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:28.082408 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-110670f3-d2b4-488a-b13b-22426235fd66 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:28.088780 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-110670f3-d2b4-488a-b13b-22426235fd66 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:28.089232 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-110670f3-d2b4-488a-b13b-22426235fd66 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:28.089997 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-110670f3-d2b4-488a-b13b-22426235fd66 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:28.090437 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-110670f3-d2b4-488a-b13b-22426235fd66 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:28.214576 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-110670f3-d2b4-488a-b13b-22426235fd66 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:28.222387 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-110670f3-d2b4-488a-b13b-22426235fd66 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1692 microversion: 2.1 time: 0.144541 May 17 12:13:28.222953 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 365/716] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:28 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1692 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:29.240082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-434cd71e-8349-4e1a-8655-a24234ffa9c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:29.240757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-434cd71e-8349-4e1a-8655-a24234ffa9c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:29.247140 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-434cd71e-8349-4e1a-8655-a24234ffa9c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:29.247594 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-434cd71e-8349-4e1a-8655-a24234ffa9c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:29.248401 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-434cd71e-8349-4e1a-8655-a24234ffa9c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:29.248847 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-434cd71e-8349-4e1a-8655-a24234ffa9c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:29.379877 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-434cd71e-8349-4e1a-8655-a24234ffa9c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:29.387477 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-434cd71e-8349-4e1a-8655-a24234ffa9c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1692 microversion: 2.1 time: 0.151866 May 17 12:13:29.388057 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 352/717] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:29 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:30.404856 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-dbae9207-695a-41af-a22a-00055324025b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:30.405457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-dbae9207-695a-41af-a22a-00055324025b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:30.412593 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbae9207-695a-41af-a22a-00055324025b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:30.413046 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbae9207-695a-41af-a22a-00055324025b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:30.413836 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbae9207-695a-41af-a22a-00055324025b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:30.414274 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-dbae9207-695a-41af-a22a-00055324025b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:30.556416 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-dbae9207-695a-41af-a22a-00055324025b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:30.563975 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-dbae9207-695a-41af-a22a-00055324025b tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1692 microversion: 2.1 time: 0.163072 May 17 12:13:30.565181 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 366/718] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:30 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:31.104047 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-46b20aa2-5af6-4dd8-8f1f-3662730d27f4 req-23a95e81-5a37-462e-a0e3-ca20188cb4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce70576a-62fb-4bcc-9163-cfc28131518a", "name": "network-vif-deleted", "tag": "50b482d3-375e-4f6c-9829-4b4c147b3dc5"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:31.113088 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-46b20aa2-5af6-4dd8-8f1f-3662730d27f4 req-23a95e81-5a37-462e-a0e3-ca20188cb4a1 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:31.113537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-46b20aa2-5af6-4dd8-8f1f-3662730d27f4 req-23a95e81-5a37-462e-a0e3-ca20188cb4a1 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:31.125507 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-46b20aa2-5af6-4dd8-8f1f-3662730d27f4 req-23a95e81-5a37-462e-a0e3-ca20188cb4a1 service nova] Creating event network-vif-deleted:50b482d3-375e-4f6c-9829-4b4c147b3dc5 for instance ce70576a-62fb-4bcc-9163-cfc28131518a on hv-cinder-83769 May 17 12:13:31.129630 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-46b20aa2-5af6-4dd8-8f1f-3662730d27f4 req-23a95e81-5a37-462e-a0e3-ca20188cb4a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029456 May 17 12:13:31.130680 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 353/719] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:31.582833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:31.583520 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:31.589865 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:31.590317 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:31.591085 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:31.591519 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:31.623110 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:31.623535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:31.623981 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.objects.instance [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lazy-loading 'fault' on Instance uuid ce70576a-62fb-4bcc-9163-cfc28131518a {{(pid=117114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:13:31.665314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:31.672996 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4d05bb0f-bf37-4abd-bcf5-539d985e9d35 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 200 len: 1336 microversion: 2.1 time: 0.094800 May 17 12:13:31.673557 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 367/720] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:31 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:32.691560 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f1816f3f-0c82-4e16-a837-87bfccf40b17 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:32.692288 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f1816f3f-0c82-4e16-a837-87bfccf40b17 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: ce70576a-62fb-4bcc-9163-cfc28131518a] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:32.698739 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f1816f3f-0c82-4e16-a837-87bfccf40b17 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:32.699184 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f1816f3f-0c82-4e16-a837-87bfccf40b17 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:32.699942 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f1816f3f-0c82-4e16-a837-87bfccf40b17 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:32.700401 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f1816f3f-0c82-4e16-a837-87bfccf40b17 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:32.715926 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-f1816f3f-0c82-4e16-a837-87bfccf40b17 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] HTTP exception thrown: Instance ce70576a-62fb-4bcc-9163-cfc28131518a could not be found. May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f1816f3f-0c82-4e16-a837-87bfccf40b17 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Request method failure captured: May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a HTTP/1.1 May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_ROk_1fuk4cSz3epPRbBpZJb2CV0MrGgAAQniHK1q4v073xWwEWOCjjjbaAzyH7LF1w321FNwq0gXKnr2mWTL4XsT6HSoqme_-3QFRdTe7OIjs4JYtwiPMJL6MsQslc-YpYZVP_mTuVvFoGMYBqqzFJ4V0WOb3GzluE0C5CvbO6aA May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 748d013ae6664fc79a9ac23e58f642e5 May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:13:32.717411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/748d013ae6664fc79a9ac23e58f642e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_748d013ae6664fc79a9ac23e58f642e5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/748d013ae6664fc79a9ac23e58f642e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/748d013ae6664fc79a9ac23e58f642e5"}]}] May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 748d013ae6664fc79a9ac23e58f642e5 May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-ServerRescueNegativeTestJSON-320091299-project May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: bb9da9200f804a4a987f2cdb49f6801d May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-ServerRescueNegativeTestJSON-320091299-project May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance ce70576a-62fb-4bcc-9163-cfc28131518a could not be found. May 17 12:13:32.719083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'ce70576a-62fb-4bcc-9163-cfc28131518a'} May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce70576a-62fb-4bcc-9163-cfc28131518a could not be found. May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:13:32.719867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce70576a-62fb-4bcc-9163-cfc28131518a could not be found. May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce70576a-62fb-4bcc-9163-cfc28131518a could not be found. May 17 12:13:32.722532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:32.723762 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f1816f3f-0c82-4e16-a837-87bfccf40b17 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Returning 404 to user: Instance ce70576a-62fb-4bcc-9163-cfc28131518a could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:13:32.723762 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f1816f3f-0c82-4e16-a837-87bfccf40b17 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a" status: 404 len: 111 microversion: 2.1 time: 0.032352 May 17 12:13:32.723762 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 354/721] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:32 2022] GET /compute/v2.1/servers/ce70576a-62fb-4bcc-9163-cfc28131518a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:13:32.728251 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-86518e47-94c1-49ed-a433-076901aee3f8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '.version_select at 0x7f2db4293c10>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:32.745695 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-86518e47-94c1-49ed-a433-076901aee3f8 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164837593" status: 202 len: 0 microversion: 2.1 time: 0.021357 May 17 12:13:32.746242 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 368/722] 10.222.0.58 () {58 vars in 1220 bytes} [Tue May 17 12:13:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164837593 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:13:35.575421 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-faf1d8d4-e985-4c0c-b182-68374c742332 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:35.575921 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-faf1d8d4-e985-4c0c-b182-68374c742332 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:35.582798 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-faf1d8d4-e985-4c0c-b182-68374c742332 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:35.583253 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-faf1d8d4-e985-4c0c-b182-68374c742332 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:35.584019 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-faf1d8d4-e985-4c0c-b182-68374c742332 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:35.584496 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-faf1d8d4-e985-4c0c-b182-68374c742332 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:35.608708 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-faf1d8d4-e985-4c0c-b182-68374c742332 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Going to try to terminate instance {{(pid=117113) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:13:35.680633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-faf1d8d4-e985-4c0c-b182-68374c742332 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 204 len: 0 microversion: 2.1 time: 0.108786 May 17 12:13:35.681391 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 355/723] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:13:35 2022] DELETE /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:13:35.690616 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-253397b7-4fa9-49d7-811f-8817e9e28edf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:35.691232 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-253397b7-4fa9-49d7-811f-8817e9e28edf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:35.697614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-253397b7-4fa9-49d7-811f-8817e9e28edf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:35.698066 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-253397b7-4fa9-49d7-811f-8817e9e28edf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:35.699098 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-253397b7-4fa9-49d7-811f-8817e9e28edf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:35.699539 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-253397b7-4fa9-49d7-811f-8817e9e28edf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:35.829647 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-253397b7-4fa9-49d7-811f-8817e9e28edf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:35.837155 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-253397b7-4fa9-49d7-811f-8817e9e28edf tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1509 microversion: 2.1 time: 0.151329 May 17 12:13:35.837719 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 369/724] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:35 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:36.855058 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d0919e19-5abc-4e5a-9bbb-f99dbeda87d9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:36.855787 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d0919e19-5abc-4e5a-9bbb-f99dbeda87d9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:36.862576 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0919e19-5abc-4e5a-9bbb-f99dbeda87d9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:36.863030 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0919e19-5abc-4e5a-9bbb-f99dbeda87d9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:36.863809 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0919e19-5abc-4e5a-9bbb-f99dbeda87d9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:36.864271 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d0919e19-5abc-4e5a-9bbb-f99dbeda87d9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:37.072310 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d0919e19-5abc-4e5a-9bbb-f99dbeda87d9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:37.089700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d0919e19-5abc-4e5a-9bbb-f99dbeda87d9 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 200 len: 1509 microversion: 2.1 time: 0.238752 May 17 12:13:37.094315 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 356/725] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:36 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:37.127272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-3de6aa28-b670-4b01-8ea6-9ef427f22166 req-20313539-705c-4c64-941e-75df89d34630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3493dcda-ee1b-44a0-9bcf-e873bb341e4c", "name": "network-vif-deleted", "tag": "107ece26-d721-49ba-a200-f81af98f0a51"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:37.137146 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-3de6aa28-b670-4b01-8ea6-9ef427f22166 req-20313539-705c-4c64-941e-75df89d34630 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:37.137737 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-3de6aa28-b670-4b01-8ea6-9ef427f22166 req-20313539-705c-4c64-941e-75df89d34630 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:37.150254 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-3de6aa28-b670-4b01-8ea6-9ef427f22166 req-20313539-705c-4c64-941e-75df89d34630 service nova] Creating event network-vif-deleted:107ece26-d721-49ba-a200-f81af98f0a51 for instance 3493dcda-ee1b-44a0-9bcf-e873bb341e4c on hv-cinder-83769 May 17 12:13:37.155206 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-3de6aa28-b670-4b01-8ea6-9ef427f22166 req-20313539-705c-4c64-941e-75df89d34630 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032132 May 17 12:13:37.156021 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 370/726] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:13:38.106047 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6dbc8738-b1f7-4955-ad93-317ca975c208 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:38.106665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-6dbc8738-b1f7-4955-ad93-317ca975c208 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 3493dcda-ee1b-44a0-9bcf-e873bb341e4c] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:38.114653 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6dbc8738-b1f7-4955-ad93-317ca975c208 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:38.115113 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6dbc8738-b1f7-4955-ad93-317ca975c208 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:38.116051 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6dbc8738-b1f7-4955-ad93-317ca975c208 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:38.116857 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-6dbc8738-b1f7-4955-ad93-317ca975c208 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:38.135230 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-6dbc8738-b1f7-4955-ad93-317ca975c208 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] HTTP exception thrown: Instance 3493dcda-ee1b-44a0-9bcf-e873bb341e4c could not be found. May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6dbc8738-b1f7-4955-ad93-317ca975c208 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Request method failure captured: May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c HTTP/1.1 May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_ROk_1fuk4cSz3epPRbBpZJb2CV0MrGgAAQniHK1q4v073xWwEWOCjjjbaAzyH7LF1w321FNwq0gXKnr2mWTL4XsT6HSoqme_-3QFRdTe7OIjs4JYtwiPMJL6MsQslc-YpYZVP_mTuVvFoGMYBqqzFJ4V0WOb3GzluE0C5CvbO6aA May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 748d013ae6664fc79a9ac23e58f642e5 May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:13:38.136915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/748d013ae6664fc79a9ac23e58f642e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_748d013ae6664fc79a9ac23e58f642e5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/748d013ae6664fc79a9ac23e58f642e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/748d013ae6664fc79a9ac23e58f642e5"}]}] May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 748d013ae6664fc79a9ac23e58f642e5 May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-ServerRescueNegativeTestJSON-320091299-project May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: bb9da9200f804a4a987f2cdb49f6801d May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-ServerRescueNegativeTestJSON-320091299-project May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 3493dcda-ee1b-44a0-9bcf-e873bb341e4c could not be found. May 17 12:13:38.138390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '3493dcda-ee1b-44a0-9bcf-e873bb341e4c'} May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3493dcda-ee1b-44a0-9bcf-e873bb341e4c could not be found. May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:13:38.139338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3493dcda-ee1b-44a0-9bcf-e873bb341e4c could not be found. May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3493dcda-ee1b-44a0-9bcf-e873bb341e4c could not be found. May 17 12:13:38.140618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:13:38.142221 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6dbc8738-b1f7-4955-ad93-317ca975c208 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Returning 404 to user: Instance 3493dcda-ee1b-44a0-9bcf-e873bb341e4c could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:13:38.142221 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6dbc8738-b1f7-4955-ad93-317ca975c208 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c" status: 404 len: 111 microversion: 2.1 time: 0.036122 May 17 12:13:38.142221 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 357/727] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:38 2022] GET /compute/v2.1/servers/3493dcda-ee1b-44a0-9bcf-e873bb341e4c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:13:38.148447 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2f7a838c-28d7-4c1f-91a8-294318b1a126 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:38.149032 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2f7a838c-28d7-4c1f-91a8-294318b1a126 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:38.155288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2f7a838c-28d7-4c1f-91a8-294318b1a126 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:38.155740 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2f7a838c-28d7-4c1f-91a8-294318b1a126 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:38.156545 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2f7a838c-28d7-4c1f-91a8-294318b1a126 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:38.156989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2f7a838c-28d7-4c1f-91a8-294318b1a126 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:38.184648 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2f7a838c-28d7-4c1f-91a8-294318b1a126 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:13:38.274248 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2f7a838c-28d7-4c1f-91a8-294318b1a126 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "DELETE /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 204 len: 0 microversion: 2.1 time: 0.129648 May 17 12:13:38.275193 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 371/728] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:13:38 2022] DELETE /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:13:38.284734 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d7e9a638-dc35-4974-97aa-ca2e29d6e4c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:38.285349 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d7e9a638-dc35-4974-97aa-ca2e29d6e4c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:38.291423 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d7e9a638-dc35-4974-97aa-ca2e29d6e4c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:38.291870 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d7e9a638-dc35-4974-97aa-ca2e29d6e4c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:38.292664 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d7e9a638-dc35-4974-97aa-ca2e29d6e4c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:38.293095 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d7e9a638-dc35-4974-97aa-ca2e29d6e4c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:38.432347 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d7e9a638-dc35-4974-97aa-ca2e29d6e4c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:38.440130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d7e9a638-dc35-4974-97aa-ca2e29d6e4c7 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.160133 May 17 12:13:38.440719 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 358/729] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:38 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:13:39.458167 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-94e14d42-4bb6-46ab-95b3-797bb03fa312 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:39.458861 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-94e14d42-4bb6-46ab-95b3-797bb03fa312 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:39.465315 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-94e14d42-4bb6-46ab-95b3-797bb03fa312 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:39.465768 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-94e14d42-4bb6-46ab-95b3-797bb03fa312 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:39.466550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-94e14d42-4bb6-46ab-95b3-797bb03fa312 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:39.466984 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-94e14d42-4bb6-46ab-95b3-797bb03fa312 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:39.595287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-94e14d42-4bb6-46ab-95b3-797bb03fa312 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:39.603736 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-94e14d42-4bb6-46ab-95b3-797bb03fa312 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.149992 May 17 12:13:39.604314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 372/730] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:39 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:40.620498 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-88dd0167-9123-46b6-a338-1f3325a9a967 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:40.621109 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-88dd0167-9123-46b6-a338-1f3325a9a967 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:40.628007 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-88dd0167-9123-46b6-a338-1f3325a9a967 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:40.628495 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-88dd0167-9123-46b6-a338-1f3325a9a967 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:40.629243 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-88dd0167-9123-46b6-a338-1f3325a9a967 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:40.629676 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-88dd0167-9123-46b6-a338-1f3325a9a967 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:40.754476 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-88dd0167-9123-46b6-a338-1f3325a9a967 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:40.761885 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-88dd0167-9123-46b6-a338-1f3325a9a967 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1522 microversion: 2.1 time: 0.145428 May 17 12:13:40.762455 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 359/731] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:40 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:41.392003 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-cf669e47-7819-4b48-aa7f-917bff29b85e req-499daff0-a9eb-4697-8078-946af7715c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883228f9-d4df-4582-b768-db398beae543", "name": "network-vif-deleted", "tag": "fba3f606-e55d-4e33-884f-dc81bbb7d9e0"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:13:41.401785 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-cf669e47-7819-4b48-aa7f-917bff29b85e req-499daff0-a9eb-4697-8078-946af7715c48 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:41.402238 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-cf669e47-7819-4b48-aa7f-917bff29b85e req-499daff0-a9eb-4697-8078-946af7715c48 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:41.414183 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-cf669e47-7819-4b48-aa7f-917bff29b85e req-499daff0-a9eb-4697-8078-946af7715c48 service nova] Creating event network-vif-deleted:fba3f606-e55d-4e33-884f-dc81bbb7d9e0 for instance 883228f9-d4df-4582-b768-db398beae543 on hv-cinder-83769 May 17 12:13:41.419714 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-cf669e47-7819-4b48-aa7f-917bff29b85e req-499daff0-a9eb-4697-8078-946af7715c48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031182 May 17 12:13:41.420536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 373/732] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:41.779026 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:41.780321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:41.787837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:41.788611 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:41.789400 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:41.789835 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:41.822871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:41.823576 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:41.824019 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lazy-loading 'fault' on Instance uuid 883228f9-d4df-4582-b768-db398beae543 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:13:41.866800 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb9da9200f804a4a987f2cdb49f6801d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748d013ae6664fc79a9ac23e58f642e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:13:41.875023 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8bb3aa80-dec2-4e41-86a1-fb5372d1fa99 tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 200 len: 1312 microversion: 2.1 time: 0.100038 May 17 12:13:41.875804 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 360/733] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:41 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:42.893107 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a1262c11-d166-4369-9234-3af1f5e2e29e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:42.893734 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a1262c11-d166-4369-9234-3af1f5e2e29e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] [instance: 883228f9-d4df-4582-b768-db398beae543] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:13:42.899933 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a1262c11-d166-4369-9234-3af1f5e2e29e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:42.900421 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a1262c11-d166-4369-9234-3af1f5e2e29e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:42.901196 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a1262c11-d166-4369-9234-3af1f5e2e29e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:13:42.901636 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a1262c11-d166-4369-9234-3af1f5e2e29e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:13:42.915341 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-a1262c11-d166-4369-9234-3af1f5e2e29e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] HTTP exception thrown: Instance 883228f9-d4df-4582-b768-db398beae543 could not be found. May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a1262c11-d166-4369-9234-3af1f5e2e29e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Request method failure captured: May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 HTTP/1.1 May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_ROk_1fuk4cSz3epPRbBpZJb2CV0MrGgAAQniHK1q4v073xWwEWOCjjjbaAzyH7LF1w321FNwq0gXKnr2mWTL4XsT6HSoqme_-3QFRdTe7OIjs4JYtwiPMJL6MsQslc-YpYZVP_mTuVvFoGMYBqqzFJ4V0WOb3GzluE0C5CvbO6aA May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 748d013ae6664fc79a9ac23e58f642e5 May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:13:42.916968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/748d013ae6664fc79a9ac23e58f642e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_748d013ae6664fc79a9ac23e58f642e5", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/748d013ae6664fc79a9ac23e58f642e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/748d013ae6664fc79a9ac23e58f642e5"}]}] May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 748d013ae6664fc79a9ac23e58f642e5 May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-320091299 May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-ServerRescueNegativeTestJSON-320091299-project May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: bb9da9200f804a4a987f2cdb49f6801d May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-ServerRescueNegativeTestJSON-320091299-project May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance 883228f9-d4df-4582-b768-db398beae543 could not be found. May 17 12:13:42.918442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '883228f9-d4df-4582-b768-db398beae543'} May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883228f9-d4df-4582-b768-db398beae543 could not be found. May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:13:42.919224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883228f9-d4df-4582-b768-db398beae543 could not be found. May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883228f9-d4df-4582-b768-db398beae543 could not be found. May 17 12:13:42.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:13:42.922283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a1262c11-d166-4369-9234-3af1f5e2e29e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] Returning 404 to user: Instance 883228f9-d4df-4582-b768-db398beae543 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:13:42.922283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a1262c11-d166-4369-9234-3af1f5e2e29e tempest-ServerRescueNegativeTestJSON-320091299 tempest-ServerRescueNegativeTestJSON-320091299-project] 10.222.0.58 "GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543" status: 404 len: 111 microversion: 2.1 time: 0.030152 May 17 12:13:42.922283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 374/734] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:13:42 2022] GET /compute/v2.1/servers/883228f9-d4df-4582-b768-db398beae543 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:13:48.580116 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a14b3d2d-f591-48bc-9f2c-b4a0afebc8c7 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db4219d30>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:48.625965 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a14b3d2d-f591-48bc-9f2c-b4a0afebc8c7 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/0ac5dfe1-229d-41a3-9811-b0d16960bfd7" status: 200 len: 351 microversion: 2.1 time: 0.049808 May 17 12:13:48.626558 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 361/735] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:13:48 2022] GET /compute/v2.1/os-volumes/0ac5dfe1-229d-41a3-9811-b0d16960bfd7 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:49.930996 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-89fa06fa-2c72-4bbf-ba17-b89615e8c274 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db4293af0>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:49.977430 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-89fa06fa-2c72-4bbf-ba17-b89615e8c274 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/3f52f699-3d2a-461b-82f7-21e46fc8180e" status: 200 len: 350 microversion: 2.1 time: 0.050185 May 17 12:13:49.978002 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 375/736] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:13:49 2022] GET /compute/v2.1/os-volumes/3f52f699-3d2a-461b-82f7-21e46fc8180e => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:51.279763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4a1d5273-9399-4d48-bb5e-fd84e2f162fa tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db41d9dc0>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:51.325025 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4a1d5273-9399-4d48-bb5e-fd84e2f162fa tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/a7897f84-28a3-41e0-8e88-6d208d035b66" status: 200 len: 350 microversion: 2.1 time: 0.049536 May 17 12:13:51.325699 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 362/737] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:13:51 2022] GET /compute/v2.1/os-volumes/a7897f84-28a3-41e0-8e88-6d208d035b66 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:51.337200 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e5437ffb-6bb7-4cc2-946b-a35b676adb00 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db42a6c10>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:51.418158 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e5437ffb-6bb7-4cc2-946b-a35b676adb00 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084670 May 17 12:13:51.419212 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 376/738] 10.222.0.58 () {58 vars in 1133 bytes} [Tue May 17 12:13:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:51.432212 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4b664364-0945-4a66-9660-4cc5c77bce68 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db418aa60>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:51.530237 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4b664364-0945-4a66-9660-4cc5c77bce68 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.101824 May 17 12:13:51.530850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 363/739] 10.222.0.58 () {58 vars in 1148 bytes} [Tue May 17 12:13:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:51.543089 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d7aa991c-db05-4d10-b228-60110b916dd3 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db4293310>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:51.621943 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d7aa991c-db05-4d10-b228-60110b916dd3 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082571 May 17 12:13:51.622513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 377/740] 10.222.0.58 () {58 vars in 1133 bytes} [Tue May 17 12:13:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:51.633735 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fcad272d-726b-4499-828b-ec89fd69971e tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db4219310>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:51.714456 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fcad272d-726b-4499-828b-ec89fd69971e tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084324 May 17 12:13:51.715041 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 364/741] 10.222.0.58 () {58 vars in 1166 bytes} [Tue May 17 12:13:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:51.727149 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2b386aed-5023-4c71-889e-4f69afa41f5e tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db446a8b0>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:51.807446 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2b386aed-5023-4c71-889e-4f69afa41f5e tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084009 May 17 12:13:51.808053 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 378/742] 10.222.0.58 () {58 vars in 1169 bytes} [Tue May 17 12:13:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:51.820473 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-69d1daa9-30cc-4f87-9e0e-27d73a476fc8 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db4184790>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:51.899704 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-69d1daa9-30cc-4f87-9e0e-27d73a476fc8 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.082699 May 17 12:13:51.900323 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 365/743] 10.222.0.58 () {58 vars in 1154 bytes} [Tue May 17 12:13:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:13:51.911280 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5200f6e1-3343-431c-908c-0f0909dcfeb3 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db436d940>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:51.990273 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5200f6e1-3343-431c-908c-0f0909dcfeb3 tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082682 May 17 12:13:51.990855 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 379/744] 10.222.0.58 () {58 vars in 1187 bytes} [Tue May 17 12:13:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:13:52.002789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-6be759af-c2b0-4d5a-ab63-8544414e3b6e tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] Calling method '.version_select at 0x7f2db42bf820>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:13:52.083474 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-6be759af-c2b0-4d5a-ab63-8544414e3b6e tempest-VolumesTestJSON-1023881456 tempest-VolumesTestJSON-1023881456-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084954 May 17 12:13:52.084046 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 366/745] 10.222.0.58 () {58 vars in 1154 bytes} [Tue May 17 12:13:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:11.313977 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b6680367-c1c0-4671-b71e-6cb0384fadf9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:11.314923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b6680367-c1c0-4671-b71e-6cb0384fadf9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:11.321344 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b6680367-c1c0-4671-b71e-6cb0384fadf9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:11.321799 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b6680367-c1c0-4671-b71e-6cb0384fadf9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:11.322572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b6680367-c1c0-4671-b71e-6cb0384fadf9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:11.323013 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b6680367-c1c0-4671-b71e-6cb0384fadf9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:11.351592 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b6680367-c1c0-4671-b71e-6cb0384fadf9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042002 May 17 12:14:11.352145 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 380/746] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:14:11 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 12:14:11.410904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-249a7cf8-379e-45ae-845d-4c65b73d82d8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:11.411393 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-249a7cf8-379e-45ae-845d-4c65b73d82d8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:11.417326 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-249a7cf8-379e-45ae-845d-4c65b73d82d8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:11.417774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-249a7cf8-379e-45ae-845d-4c65b73d82d8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:11.418535 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-249a7cf8-379e-45ae-845d-4c65b73d82d8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:11.418968 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-249a7cf8-379e-45ae-845d-4c65b73d82d8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:11.443744 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-249a7cf8-379e-45ae-845d-4c65b73d82d8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Going to try to terminate instance {{(pid=117113) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:14:11.517671 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-249a7cf8-379e-45ae-845d-4c65b73d82d8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 204 len: 0 microversion: 2.1 time: 0.110823 May 17 12:14:11.518271 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 367/747] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:14:11 2022] DELETE /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:14:11.526600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c15948bf-a287-4309-b157-3f258f20bdfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:11.527712 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c15948bf-a287-4309-b157-3f258f20bdfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:11.533081 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c15948bf-a287-4309-b157-3f258f20bdfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:11.533530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c15948bf-a287-4309-b157-3f258f20bdfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:11.534460 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c15948bf-a287-4309-b157-3f258f20bdfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:11.534927 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c15948bf-a287-4309-b157-3f258f20bdfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:11.662896 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c15948bf-a287-4309-b157-3f258f20bdfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:11.670183 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c15948bf-a287-4309-b157-3f258f20bdfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1670 microversion: 2.1 time: 0.147439 May 17 12:14:11.670757 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 381/748] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:11 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:12.687503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-21274edd-fee5-4200-9541-1bead5165f0b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:12.688230 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-21274edd-fee5-4200-9541-1bead5165f0b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:12.695079 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-21274edd-fee5-4200-9541-1bead5165f0b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:12.695530 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-21274edd-fee5-4200-9541-1bead5165f0b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:12.696338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-21274edd-fee5-4200-9541-1bead5165f0b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:12.696781 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-21274edd-fee5-4200-9541-1bead5165f0b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:12.828671 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-21274edd-fee5-4200-9541-1bead5165f0b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:12.836618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-21274edd-fee5-4200-9541-1bead5165f0b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1670 microversion: 2.1 time: 0.153497 May 17 12:14:12.837181 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 368/749] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:12 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:13.853502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d2e4daee-3b7d-4b27-8ddb-c49481af9a73 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:13.854736 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d2e4daee-3b7d-4b27-8ddb-c49481af9a73 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:13.861054 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2e4daee-3b7d-4b27-8ddb-c49481af9a73 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:13.861675 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2e4daee-3b7d-4b27-8ddb-c49481af9a73 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:13.862431 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2e4daee-3b7d-4b27-8ddb-c49481af9a73 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:13.862946 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d2e4daee-3b7d-4b27-8ddb-c49481af9a73 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:14.016936 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d2e4daee-3b7d-4b27-8ddb-c49481af9a73 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:14.024425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d2e4daee-3b7d-4b27-8ddb-c49481af9a73 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 200 len: 1670 microversion: 2.1 time: 0.174658 May 17 12:14:14.025005 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 382/750] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:13 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:14.231236 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-73d31f82-64b2-4883-8e5b-44407f5e0c5b req-a96ab958-a9e1-4344-82d3-e2d40b4f6213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7d37bf-7c1d-43d6-9ede-a2e330b5a043", "name": "network-vif-deleted", "tag": "b58f565e-dd05-47fe-9192-f26d8c0f0286"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:14:14.240714 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-73d31f82-64b2-4883-8e5b-44407f5e0c5b req-a96ab958-a9e1-4344-82d3-e2d40b4f6213 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:14.241245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-73d31f82-64b2-4883-8e5b-44407f5e0c5b req-a96ab958-a9e1-4344-82d3-e2d40b4f6213 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:14.252514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-73d31f82-64b2-4883-8e5b-44407f5e0c5b req-a96ab958-a9e1-4344-82d3-e2d40b4f6213 service nova] Creating event network-vif-deleted:b58f565e-dd05-47fe-9192-f26d8c0f0286 for instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 on hv-cinder-83769 May 17 12:14:14.258043 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-73d31f82-64b2-4883-8e5b-44407f5e0c5b req-a96ab958-a9e1-4344-82d3-e2d40b4f6213 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030582 May 17 12:14:14.258901 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 369/751] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:14:15.043163 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1138218d-b2e6-49fa-87b7-f19df489b1dd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:15.043817 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1138218d-b2e6-49fa-87b7-f19df489b1dd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:15.051619 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1138218d-b2e6-49fa-87b7-f19df489b1dd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:15.052227 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1138218d-b2e6-49fa-87b7-f19df489b1dd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:15.053236 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1138218d-b2e6-49fa-87b7-f19df489b1dd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:15.053683 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1138218d-b2e6-49fa-87b7-f19df489b1dd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:15.070132 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-1138218d-b2e6-49fa-87b7-f19df489b1dd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] HTTP exception thrown: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1138218d-b2e6-49fa-87b7-f19df489b1dd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Request method failure captured: May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 HTTP/1.1 May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_Ire0y3NWrIHMMW3XR3Z7e0zp0KTLbY_tfcbTu6RFVpq3lxFmcRph7RFHr0_HQdmVwD3Ce7NlNqzogum-WQMp5XODqISdobMg8nCF5UKXPYjjhlQjvaCFQNomU5xzNwDHNs_wkkcqBVGQEfpitOCOfEv0OEwMg9WHDjYe2H3dSv4M May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 2ae797920785457f975f9f85d80849af May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:14:15.072115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2ae797920785457f975f9f85d80849af", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2ae797920785457f975f9f85d80849af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}] May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeTestJSON-2050431149 May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 2ae797920785457f975f9f85d80849af May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 79ff688720854ad1b62b3c9b51546e0f May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:14:15.074010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '7d7d37bf-7c1d-43d6-9ede-a2e330b5a043'} May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:14:15.075264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:14:15.076903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:14:15.078262 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1138218d-b2e6-49fa-87b7-f19df489b1dd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Returning 404 to user: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:14:15.078262 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1138218d-b2e6-49fa-87b7-f19df489b1dd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 404 len: 111 microversion: 2.1 time: 0.035258 May 17 12:14:15.078262 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 383/752] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:15 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:14:15.085940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a7d906d8-b29e-4f71-b569-909022442fc7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '.version_select at 0x7f2db41ad700>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:15.105429 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a7d906d8-b29e-4f71-b569-909022442fc7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445600030" status: 202 len: 0 microversion: 2.1 time: 0.024774 May 17 12:14:15.106663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 370/753] 10.222.0.58 () {58 vars in 1217 bytes} [Tue May 17 12:14:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445600030 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:14:15.743061 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9eea53d8-8ee9-4cd5-8c04-095787d55d48 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'create', calling method: .version_select at 0x7f2db42a61f0>, body: {"keypair": {"name": "tempest-keypair-727529117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdifmfwDBNf+1gYYG27lSvqTPnLr+2xu1xXeEIfrw2r20X00Q2qfFbomYZ4HgBEuJZ/qGpvU2JfKxCmgpa9XvfBWimVm0S28X1q9T8vaZuouznWJIEylxhkdhuj0xX/hQ=="}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:14:15.757385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-9eea53d8-8ee9-4cd5-8c04-095787d55d48 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Getting quotas for project 2ae797920785457f975f9f85d80849af. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:14:15.761721 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-9eea53d8-8ee9-4cd5-8c04-095787d55d48 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Getting quotas for user 79ff688720854ad1b62b3c9b51546e0f and project 2ae797920785457f975f9f85d80849af. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:14:15.788838 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9eea53d8-8ee9-4cd5-8c04-095787d55d48 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050328 May 17 12:14:15.789448 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 384/754] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 17 12:14:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:14:17.147693 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1706904299", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94b88bbc-a9e8-40ae-bcc3-9f4064606643"}], "security_groups": [{"name": "tempest-securitygroup--827173793"}], "key_name": "tempest-keypair-727529117", "user_data": "}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:14:17.258141 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] validate_networks() for [('94b88bbc-a9e8-40ae-bcc3-9f4064606643', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:14:17.678916 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:14:17.679333 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:14:17.679807 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:14:17.680245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:14:17.680658 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:14:17.689089 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:17.689530 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:17.690328 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:17.690760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:17.707867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Getting quotas for project 2ae797920785457f975f9f85d80849af. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:14:17.711699 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Getting quotas for user 79ff688720854ad1b62b3c9b51546e0f and project 2ae797920785457f975f9f85d80849af. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:14:17.722146 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:14:17.724453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:14:17.768857 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fd9279c1-0ad2-4851-82c8-00fa182dda31 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.626393 May 17 12:14:17.769509 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 371/755] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:14:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:14:17.780438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9fc9cb35-79f3-4873-bf6e-ceaa71875f8a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:17.781049 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9fc9cb35-79f3-4873-bf6e-ceaa71875f8a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:17.834534 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9fc9cb35-79f3-4873-bf6e-ceaa71875f8a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:17.841259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9fc9cb35-79f3-4873-bf6e-ceaa71875f8a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1237 microversion: 2.1 time: 0.065142 May 17 12:14:17.841897 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 385/756] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:17 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:18.858711 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3b1abdfe-cf2a-4299-881e-7cdab8dda818 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:18.859321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-3b1abdfe-cf2a-4299-881e-7cdab8dda818 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:18.866914 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3b1abdfe-cf2a-4299-881e-7cdab8dda818 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:18.867368 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3b1abdfe-cf2a-4299-881e-7cdab8dda818 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:18.868147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3b1abdfe-cf2a-4299-881e-7cdab8dda818 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:18.868612 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3b1abdfe-cf2a-4299-881e-7cdab8dda818 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:18.930073 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3b1abdfe-cf2a-4299-881e-7cdab8dda818 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:18.937586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-3b1abdfe-cf2a-4299-881e-7cdab8dda818 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1295 microversion: 2.1 time: 0.083384 May 17 12:14:18.938157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 372/757] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:18 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1295 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:19.955467 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1d1c2945-ae25-4d6d-a086-8390e5427f94 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:19.956087 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1d1c2945-ae25-4d6d-a086-8390e5427f94 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:19.963225 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d1c2945-ae25-4d6d-a086-8390e5427f94 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:19.963683 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d1c2945-ae25-4d6d-a086-8390e5427f94 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:19.964467 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d1c2945-ae25-4d6d-a086-8390e5427f94 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:19.964907 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d1c2945-ae25-4d6d-a086-8390e5427f94 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:20.095402 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1d1c2945-ae25-4d6d-a086-8390e5427f94 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:20.103089 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1d1c2945-ae25-4d6d-a086-8390e5427f94 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.151469 May 17 12:14:20.103664 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 386/758] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:19 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:21.120495 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5238f4e9-5ba9-47f5-b2a5-19410e079900 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:21.121226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5238f4e9-5ba9-47f5-b2a5-19410e079900 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:21.127523 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5238f4e9-5ba9-47f5-b2a5-19410e079900 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:21.127976 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5238f4e9-5ba9-47f5-b2a5-19410e079900 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:21.128829 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5238f4e9-5ba9-47f5-b2a5-19410e079900 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:21.129876 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5238f4e9-5ba9-47f5-b2a5-19410e079900 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:21.260481 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5238f4e9-5ba9-47f5-b2a5-19410e079900 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:21.267652 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5238f4e9-5ba9-47f5-b2a5-19410e079900 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.151230 May 17 12:14:21.268250 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 373/759] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:21 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:21.950896 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-ff53833c-9246-4ce3-886e-dac4f4a50710 req-c1f894e5-330b-402c-8dab-19792180623d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1173f42-664f-4561-8e8f-0842a8d139cc", "tag": "92cac3bc-855a-4b91-acf1-b871ad7271cc"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:14:21.961409 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-ff53833c-9246-4ce3-886e-dac4f4a50710 req-c1f894e5-330b-402c-8dab-19792180623d service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:21.961855 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-ff53833c-9246-4ce3-886e-dac4f4a50710 req-c1f894e5-330b-402c-8dab-19792180623d service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:21.980233 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-ff53833c-9246-4ce3-886e-dac4f4a50710 req-c1f894e5-330b-402c-8dab-19792180623d service nova] Creating event network-changed:92cac3bc-855a-4b91-acf1-b871ad7271cc for instance d1173f42-664f-4561-8e8f-0842a8d139cc on hv-cinder-83769 May 17 12:14:21.985948 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-ff53833c-9246-4ce3-886e-dac4f4a50710 req-c1f894e5-330b-402c-8dab-19792180623d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040182 May 17 12:14:21.986529 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 387/760] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:14:22.284564 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-88e41616-1af8-4001-8b42-ec73d43208db tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:22.285115 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-88e41616-1af8-4001-8b42-ec73d43208db tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:22.291626 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-88e41616-1af8-4001-8b42-ec73d43208db tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:22.292199 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-88e41616-1af8-4001-8b42-ec73d43208db tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:22.293152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-88e41616-1af8-4001-8b42-ec73d43208db tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:22.293630 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-88e41616-1af8-4001-8b42-ec73d43208db tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:22.421913 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-88e41616-1af8-4001-8b42-ec73d43208db tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:22.429391 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-88e41616-1af8-4001-8b42-ec73d43208db tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.148741 May 17 12:14:22.429980 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 374/761] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:22 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:23.447253 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-af8ec8dd-0851-45d8-b4fb-6448d315ac5b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:23.448075 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-af8ec8dd-0851-45d8-b4fb-6448d315ac5b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:23.454476 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-af8ec8dd-0851-45d8-b4fb-6448d315ac5b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:23.454928 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-af8ec8dd-0851-45d8-b4fb-6448d315ac5b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:23.455699 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-af8ec8dd-0851-45d8-b4fb-6448d315ac5b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:23.456138 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-af8ec8dd-0851-45d8-b4fb-6448d315ac5b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:23.589438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-af8ec8dd-0851-45d8-b4fb-6448d315ac5b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:23.596771 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-af8ec8dd-0851-45d8-b4fb-6448d315ac5b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.154206 May 17 12:14:23.597361 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 388/762] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:23 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:24.614896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d1612698-d1aa-4116-982a-56fe614a0ca8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:24.615510 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d1612698-d1aa-4116-982a-56fe614a0ca8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:24.621866 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1612698-d1aa-4116-982a-56fe614a0ca8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:24.622319 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1612698-d1aa-4116-982a-56fe614a0ca8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:24.623088 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1612698-d1aa-4116-982a-56fe614a0ca8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:24.623528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1612698-d1aa-4116-982a-56fe614a0ca8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:24.754220 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d1612698-d1aa-4116-982a-56fe614a0ca8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:24.761497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d1612698-d1aa-4116-982a-56fe614a0ca8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.151086 May 17 12:14:24.762072 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 375/763] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:24 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:25.777191 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a4e0fb6e-1c16-474f-a515-ad69c28612eb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:25.777810 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a4e0fb6e-1c16-474f-a515-ad69c28612eb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:25.784235 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a4e0fb6e-1c16-474f-a515-ad69c28612eb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:25.784692 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a4e0fb6e-1c16-474f-a515-ad69c28612eb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:25.786058 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a4e0fb6e-1c16-474f-a515-ad69c28612eb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:25.786497 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a4e0fb6e-1c16-474f-a515-ad69c28612eb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:25.910666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a4e0fb6e-1c16-474f-a515-ad69c28612eb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:25.917824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a4e0fb6e-1c16-474f-a515-ad69c28612eb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.144496 May 17 12:14:25.918394 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 389/764] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:25 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:26.934858 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-975e3a2f-fce4-4a6d-93a9-12865f8ceacc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:26.935467 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-975e3a2f-fce4-4a6d-93a9-12865f8ceacc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:26.941592 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-975e3a2f-fce4-4a6d-93a9-12865f8ceacc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:26.942043 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-975e3a2f-fce4-4a6d-93a9-12865f8ceacc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:26.942806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-975e3a2f-fce4-4a6d-93a9-12865f8ceacc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:26.943235 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-975e3a2f-fce4-4a6d-93a9-12865f8ceacc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:27.068385 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-975e3a2f-fce4-4a6d-93a9-12865f8ceacc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:27.075897 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-975e3a2f-fce4-4a6d-93a9-12865f8ceacc tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.144954 May 17 12:14:27.076507 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 376/765] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:26 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:28.093260 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-815d36b2-c388-4493-a2fc-66619cda1bd8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:28.093784 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-815d36b2-c388-4493-a2fc-66619cda1bd8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:28.100628 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-815d36b2-c388-4493-a2fc-66619cda1bd8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:28.101078 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-815d36b2-c388-4493-a2fc-66619cda1bd8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:28.101852 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-815d36b2-c388-4493-a2fc-66619cda1bd8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:28.102313 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-815d36b2-c388-4493-a2fc-66619cda1bd8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:28.231328 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-815d36b2-c388-4493-a2fc-66619cda1bd8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:28.239082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-815d36b2-c388-4493-a2fc-66619cda1bd8 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.149225 May 17 12:14:28.239651 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 390/766] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:28 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:29.255204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-76930e01-4034-4b45-82f0-2194b6a0ff42 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:29.255819 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-76930e01-4034-4b45-82f0-2194b6a0ff42 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:29.267637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76930e01-4034-4b45-82f0-2194b6a0ff42 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:29.268096 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76930e01-4034-4b45-82f0-2194b6a0ff42 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:29.268957 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76930e01-4034-4b45-82f0-2194b6a0ff42 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:29.269874 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76930e01-4034-4b45-82f0-2194b6a0ff42 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:29.401888 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-76930e01-4034-4b45-82f0-2194b6a0ff42 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:29.409250 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-76930e01-4034-4b45-82f0-2194b6a0ff42 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.158363 May 17 12:14:29.409828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 377/767] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:29 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:30.426904 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6f0a7659-5fc3-49cc-b3c0-2fcdc162ff4b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:30.427546 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6f0a7659-5fc3-49cc-b3c0-2fcdc162ff4b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:30.434015 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6f0a7659-5fc3-49cc-b3c0-2fcdc162ff4b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:30.434456 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6f0a7659-5fc3-49cc-b3c0-2fcdc162ff4b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:30.435229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6f0a7659-5fc3-49cc-b3c0-2fcdc162ff4b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:30.435660 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6f0a7659-5fc3-49cc-b3c0-2fcdc162ff4b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:30.561136 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6f0a7659-5fc3-49cc-b3c0-2fcdc162ff4b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:30.568892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6f0a7659-5fc3-49cc-b3c0-2fcdc162ff4b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.146477 May 17 12:14:30.569457 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 391/768] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:30 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:31.587598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9a3ad4d2-cdc3-4c18-90b9-c39e69857925 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:31.588512 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9a3ad4d2-cdc3-4c18-90b9-c39e69857925 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:31.595039 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9a3ad4d2-cdc3-4c18-90b9-c39e69857925 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:31.595491 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9a3ad4d2-cdc3-4c18-90b9-c39e69857925 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:31.596284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9a3ad4d2-cdc3-4c18-90b9-c39e69857925 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:31.596722 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9a3ad4d2-cdc3-4c18-90b9-c39e69857925 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:31.722050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-9a3ad4d2-cdc3-4c18-90b9-c39e69857925 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:31.729898 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-9a3ad4d2-cdc3-4c18-90b9-c39e69857925 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.146226 May 17 12:14:31.730502 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 378/769] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:31 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:32.746867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2247d204-180e-44dc-aabf-2296148bbd9e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:32.747475 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2247d204-180e-44dc-aabf-2296148bbd9e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:32.753752 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2247d204-180e-44dc-aabf-2296148bbd9e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:32.754199 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2247d204-180e-44dc-aabf-2296148bbd9e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:32.754957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2247d204-180e-44dc-aabf-2296148bbd9e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:32.755501 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2247d204-180e-44dc-aabf-2296148bbd9e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:32.884037 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2247d204-180e-44dc-aabf-2296148bbd9e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:32.891252 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2247d204-180e-44dc-aabf-2296148bbd9e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.148261 May 17 12:14:32.891822 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 392/770] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:32 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:33.907529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-147a445a-982e-4b1d-9dcf-670ef35290ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:33.908137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-147a445a-982e-4b1d-9dcf-670ef35290ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:33.914439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-147a445a-982e-4b1d-9dcf-670ef35290ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:33.914880 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-147a445a-982e-4b1d-9dcf-670ef35290ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:33.915639 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-147a445a-982e-4b1d-9dcf-670ef35290ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:33.916072 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-147a445a-982e-4b1d-9dcf-670ef35290ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:34.049209 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-147a445a-982e-4b1d-9dcf-670ef35290ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:34.057390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-147a445a-982e-4b1d-9dcf-670ef35290ac tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.153653 May 17 12:14:34.057962 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 379/771] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:33 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:35.074744 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8fa142ca-eb05-4ec3-8769-3599d1a137ce tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:35.075381 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8fa142ca-eb05-4ec3-8769-3599d1a137ce tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:35.083666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8fa142ca-eb05-4ec3-8769-3599d1a137ce tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:35.083666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8fa142ca-eb05-4ec3-8769-3599d1a137ce tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:35.083914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8fa142ca-eb05-4ec3-8769-3599d1a137ce tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:35.084365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8fa142ca-eb05-4ec3-8769-3599d1a137ce tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:35.218892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8fa142ca-eb05-4ec3-8769-3599d1a137ce tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:35.227190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8fa142ca-eb05-4ec3-8769-3599d1a137ce tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.156484 May 17 12:14:35.227759 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 393/772] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:35 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:36.202916 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-1f9977a2-26e8-416f-9255-7675726a524a req-a166edd9-486d-42c6-a4b9-debf2dc43c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1173f42-664f-4561-8e8f-0842a8d139cc", "name": "network-vif-plugged", "status": "completed", "tag": "92cac3bc-855a-4b91-acf1-b871ad7271cc"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:14:36.214490 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-1f9977a2-26e8-416f-9255-7675726a524a req-a166edd9-486d-42c6-a4b9-debf2dc43c27 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:36.214961 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-1f9977a2-26e8-416f-9255-7675726a524a req-a166edd9-486d-42c6-a4b9-debf2dc43c27 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:36.229426 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-1f9977a2-26e8-416f-9255-7675726a524a req-a166edd9-486d-42c6-a4b9-debf2dc43c27 service nova] Creating event network-vif-plugged:92cac3bc-855a-4b91-acf1-b871ad7271cc for instance d1173f42-664f-4561-8e8f-0842a8d139cc on hv-cinder-83769 May 17 12:14:36.234503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-1f9977a2-26e8-416f-9255-7675726a524a req-a166edd9-486d-42c6-a4b9-debf2dc43c27 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045067 May 17 12:14:36.236356 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 380/773] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:14:36.243426 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2df114ec-c1ed-4a72-821e-f318a774d922 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:36.244045 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2df114ec-c1ed-4a72-821e-f318a774d922 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:36.250309 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2df114ec-c1ed-4a72-821e-f318a774d922 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:36.250760 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2df114ec-c1ed-4a72-821e-f318a774d922 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:36.251532 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2df114ec-c1ed-4a72-821e-f318a774d922 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:36.251969 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2df114ec-c1ed-4a72-821e-f318a774d922 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:36.379843 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2df114ec-c1ed-4a72-821e-f318a774d922 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:36.388848 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2df114ec-c1ed-4a72-821e-f318a774d922 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.149438 May 17 12:14:36.389548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 394/774] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:36 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:14:37.407207 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f7a715e1-4213-4099-825b-5e5f89f1cd6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:37.407922 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f7a715e1-4213-4099-825b-5e5f89f1cd6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:37.414735 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f7a715e1-4213-4099-825b-5e5f89f1cd6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:37.415197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f7a715e1-4213-4099-825b-5e5f89f1cd6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:37.416044 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f7a715e1-4213-4099-825b-5e5f89f1cd6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:37.416515 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f7a715e1-4213-4099-825b-5e5f89f1cd6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:37.655215 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f7a715e1-4213-4099-825b-5e5f89f1cd6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:37.662969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f7a715e1-4213-4099-825b-5e5f89f1cd6e tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1362 microversion: 2.1 time: 0.260481 May 17 12:14:37.663549 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 381/775] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:37 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:38.253604 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b7f748e4-f2c6-480a-ad02-48b880294776 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:38.254233 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b7f748e4-f2c6-480a-ad02-48b880294776 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:38.259691 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-befda0a5-eaa7-4ea9-ad60-aad2829b240f req-ec4a527c-2146-4f36-8766-b27f0392a2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bf4c33-50e2-4e81-aa3e-98ef857d0628", "tag": "ce775399-8aaa-44e2-8bad-de44d822b044"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:14:38.262151 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b7f748e4-f2c6-480a-ad02-48b880294776 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:38.262672 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b7f748e4-f2c6-480a-ad02-48b880294776 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:38.263521 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b7f748e4-f2c6-480a-ad02-48b880294776 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:38.264029 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b7f748e4-f2c6-480a-ad02-48b880294776 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:38.267983 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-befda0a5-eaa7-4ea9-ad60-aad2829b240f req-ec4a527c-2146-4f36-8766-b27f0392a2c4 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:38.268452 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-befda0a5-eaa7-4ea9-ad60-aad2829b240f req-ec4a527c-2146-4f36-8766-b27f0392a2c4 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:38.280129 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-befda0a5-eaa7-4ea9-ad60-aad2829b240f req-ec4a527c-2146-4f36-8766-b27f0392a2c4 service nova] Creating event network-changed:ce775399-8aaa-44e2-8bad-de44d822b044 for instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 on hv-cinder-83769 May 17 12:14:38.285339 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-befda0a5-eaa7-4ea9-ad60-aad2829b240f req-ec4a527c-2146-4f36-8766-b27f0392a2c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029965 May 17 12:14:38.286175 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 382/776] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:14:38.290627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b7f748e4-f2c6-480a-ad02-48b880294776 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:14:38.399647 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b7f748e4-f2c6-480a-ad02-48b880294776 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "DELETE /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 204 len: 0 microversion: 2.1 time: 0.149202 May 17 12:14:38.400316 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 395/777] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:14:38 2022] DELETE /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:14:38.409743 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c3da8a0f-1e20-45a6-bafd-41a3b4ea2473 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:38.411199 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c3da8a0f-1e20-45a6-bafd-41a3b4ea2473 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:38.417687 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c3da8a0f-1e20-45a6-bafd-41a3b4ea2473 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:38.418503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c3da8a0f-1e20-45a6-bafd-41a3b4ea2473 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:38.419353 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c3da8a0f-1e20-45a6-bafd-41a3b4ea2473 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:38.419868 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c3da8a0f-1e20-45a6-bafd-41a3b4ea2473 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:38.560698 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c3da8a0f-1e20-45a6-bafd-41a3b4ea2473 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:38.569056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c3da8a0f-1e20-45a6-bafd-41a3b4ea2473 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.163842 May 17 12:14:38.569769 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 383/778] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:38 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:38.680057 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3c4e99e4-e4ed-447c-8399-4d8bdaa5cd96 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:38.680791 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3c4e99e4-e4ed-447c-8399-4d8bdaa5cd96 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:38.686770 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c4e99e4-e4ed-447c-8399-4d8bdaa5cd96 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:38.687227 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c4e99e4-e4ed-447c-8399-4d8bdaa5cd96 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:38.688142 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c4e99e4-e4ed-447c-8399-4d8bdaa5cd96 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:38.688535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c4e99e4-e4ed-447c-8399-4d8bdaa5cd96 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:38.829413 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3c4e99e4-e4ed-447c-8399-4d8bdaa5cd96 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:38.839695 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3c4e99e4-e4ed-447c-8399-4d8bdaa5cd96 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1546 microversion: 2.1 time: 0.164326 May 17 12:14:38.840726 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 396/779] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:38 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:38.859799 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b65ad97d-c8ff-49a8-954e-239f04b60018 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:38.860335 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b65ad97d-c8ff-49a8-954e-239f04b60018 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:38.866666 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b65ad97d-c8ff-49a8-954e-239f04b60018 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:38.867114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b65ad97d-c8ff-49a8-954e-239f04b60018 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:38.867947 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b65ad97d-c8ff-49a8-954e-239f04b60018 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:38.868423 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b65ad97d-c8ff-49a8-954e-239f04b60018 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:38.951982 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b65ad97d-c8ff-49a8-954e-239f04b60018 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096200 May 17 12:14:38.953072 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 384/780] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 17 12:14:38 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:14:39.590099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-05ee3f57-87f0-4c77-8ab0-68531617c99c tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:39.590825 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-05ee3f57-87f0-4c77-8ab0-68531617c99c tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:39.597668 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-05ee3f57-87f0-4c77-8ab0-68531617c99c tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:39.598115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-05ee3f57-87f0-4c77-8ab0-68531617c99c tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:39.599390 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-05ee3f57-87f0-4c77-8ab0-68531617c99c tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:39.600005 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-05ee3f57-87f0-4c77-8ab0-68531617c99c tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:39.765211 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-05ee3f57-87f0-4c77-8ab0-68531617c99c tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:39.775101 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-05ee3f57-87f0-4c77-8ab0-68531617c99c tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.191698 May 17 12:14:39.785094 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 397/781] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:39 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:40.302477 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-258710a6-c949-49f6-9255-7c0cf11b0d88 req-ebfa89fd-2934-4aca-9122-7d25c1e34ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1173f42-664f-4561-8e8f-0842a8d139cc", "tag": "92cac3bc-855a-4b91-acf1-b871ad7271cc"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:14:40.311074 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-258710a6-c949-49f6-9255-7c0cf11b0d88 req-ebfa89fd-2934-4aca-9122-7d25c1e34ba2 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:40.311524 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-258710a6-c949-49f6-9255-7c0cf11b0d88 req-ebfa89fd-2934-4aca-9122-7d25c1e34ba2 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:40.324838 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-258710a6-c949-49f6-9255-7c0cf11b0d88 req-ebfa89fd-2934-4aca-9122-7d25c1e34ba2 service nova] Creating event network-changed:92cac3bc-855a-4b91-acf1-b871ad7271cc for instance d1173f42-664f-4561-8e8f-0842a8d139cc on hv-cinder-83769 May 17 12:14:40.330296 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-258710a6-c949-49f6-9255-7c0cf11b0d88 req-ebfa89fd-2934-4aca-9122-7d25c1e34ba2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031994 May 17 12:14:40.331115 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 385/782] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:14:40.794069 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f2d79c7d-4421-4eaf-8653-f2462d410623 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:40.795919 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f2d79c7d-4421-4eaf-8653-f2462d410623 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:40.807705 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2d79c7d-4421-4eaf-8653-f2462d410623 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:40.808165 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2d79c7d-4421-4eaf-8653-f2462d410623 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:40.808989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2d79c7d-4421-4eaf-8653-f2462d410623 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:40.809488 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2d79c7d-4421-4eaf-8653-f2462d410623 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:41.054095 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f2d79c7d-4421-4eaf-8653-f2462d410623 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:41.067155 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f2d79c7d-4421-4eaf-8653-f2462d410623 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1567 microversion: 2.1 time: 0.278115 May 17 12:14:41.068950 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 398/783] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:40 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1567 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:42.087299 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:42.087995 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:42.094616 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:42.095312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:42.096084 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:42.096721 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:42.131902 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:42.132634 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:42.133261 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lazy-loading 'fault' on Instance uuid 30bf4c33-50e2-4e81-aa3e-98ef857d0628 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:14:42.224986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7330cf580a8644d28bfca1eb4cb75fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b64f5e92ae4a0a9f756026c2e398af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:14:42.233448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c3f88368-520a-4732-a79b-fd623cb7afe1 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 200 len: 1223 microversion: 2.1 time: 0.151486 May 17 12:14:42.234409 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 386/784] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:42 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 1223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:14:42.360572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-a180359b-5f6b-4744-8562-536cf4d67ea8 req-4c172bc7-67d9-4750-90ad-6bf053dd7756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bf4c33-50e2-4e81-aa3e-98ef857d0628", "name": "network-vif-deleted", "tag": "ce775399-8aaa-44e2-8bad-de44d822b044"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:14:42.385847 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-a180359b-5f6b-4744-8562-536cf4d67ea8 req-4c172bc7-67d9-4750-90ad-6bf053dd7756 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:42.386376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-a180359b-5f6b-4744-8562-536cf4d67ea8 req-4c172bc7-67d9-4750-90ad-6bf053dd7756 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:42.410046 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-a180359b-5f6b-4744-8562-536cf4d67ea8 req-4c172bc7-67d9-4750-90ad-6bf053dd7756 service nova] Creating event network-vif-deleted:ce775399-8aaa-44e2-8bad-de44d822b044 for instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 on hv-cinder-83769 May 17 12:14:42.426348 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-a180359b-5f6b-4744-8562-536cf4d67ea8 req-4c172bc7-67d9-4750-90ad-6bf053dd7756 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069618 May 17 12:14:42.429629 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 399/785] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:14:43.250813 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-782844a4-adc1-43aa-98d1-453e31c43d14 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:43.251512 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-782844a4-adc1-43aa-98d1-453e31c43d14 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] [instance: 30bf4c33-50e2-4e81-aa3e-98ef857d0628] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:43.258129 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-782844a4-adc1-43aa-98d1-453e31c43d14 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:43.258583 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-782844a4-adc1-43aa-98d1-453e31c43d14 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:43.259374 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-782844a4-adc1-43aa-98d1-453e31c43d14 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:43.259812 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-782844a4-adc1-43aa-98d1-453e31c43d14 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:43.274840 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-782844a4-adc1-43aa-98d1-453e31c43d14 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] HTTP exception thrown: Instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 could not be found. May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-782844a4-adc1-43aa-98d1-453e31c43d14 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Request method failure captured: May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 HTTP/1.1 May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig5AqHwzpGy0sXiYAzjNx_3475ADxYIZZh0iZEk_c2cP4WHkCCXKpur_Q3hQ4LBZAHwNmrncx4f_2YS3pHYb__EDAefrWVqiGAXZ9v-C07QTHLksUb-2plmpXhtqCrfydo7PE6JY0ql8DvKYTRTwB2VmfUn1x8YJBMB_FMgKjZivsH4M May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 76b64f5e92ae4a0a9f756026c2e398af May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-TestShelveInstance-1639342750 May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:14:43.276623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76b64f5e92ae4a0a9f756026c2e398af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_76b64f5e92ae4a0a9f756026c2e398af", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/76b64f5e92ae4a0a9f756026c2e398af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/76b64f5e92ae4a0a9f756026c2e398af"}]}] May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-TestShelveInstance-1639342750 May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 76b64f5e92ae4a0a9f756026c2e398af May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-TestShelveInstance-1639342750 May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-TestShelveInstance-1639342750-project May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 7330cf580a8644d28bfca1eb4cb75fb4 May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-TestShelveInstance-1639342750-project May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 could not be found. May 17 12:14:43.278005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '30bf4c33-50e2-4e81-aa3e-98ef857d0628'} May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 could not be found. May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:14:43.278773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 could not be found. May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 could not be found. May 17 12:14:43.280011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:14:43.281198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-782844a4-adc1-43aa-98d1-453e31c43d14 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Returning 404 to user: Instance 30bf4c33-50e2-4e81-aa3e-98ef857d0628 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:14:43.281198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-782844a4-adc1-43aa-98d1-453e31c43d14 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628" status: 404 len: 111 microversion: 2.1 time: 0.031107 May 17 12:14:43.281198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 387/786] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:14:43 2022] GET /compute/v2.1/servers/30bf4c33-50e2-4e81-aa3e-98ef857d0628 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:14:43.486479 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-eb0ea829-78e5-4dc0-8655-64b896b4b3e2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] Calling method '.version_select at 0x7f2db4235f70>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:43.521515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-eb0ea829-78e5-4dc0-8655-64b896b4b3e2 tempest-TestShelveInstance-1639342750 tempest-TestShelveInstance-1639342750-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-270066880" status: 202 len: 0 microversion: 2.1 time: 0.041099 May 17 12:14:43.532546 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 400/787] 10.222.0.58 () {58 vars in 1250 bytes} [Tue May 17 12:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-270066880 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:14:52.562177 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-503ba50c-9103-4ace-8e08-78237a45255f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:14:52.563824 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-503ba50c-9103-4ace-8e08-78237a45255f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:52.578554 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-503ba50c-9103-4ace-8e08-78237a45255f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:52.579482 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-503ba50c-9103-4ace-8e08-78237a45255f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:52.581530 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-503ba50c-9103-4ace-8e08-78237a45255f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:52.582125 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-503ba50c-9103-4ace-8e08-78237a45255f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:52.621372 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-503ba50c-9103-4ace-8e08-78237a45255f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/ips" status: 200 len: 149 microversion: 2.1 time: 0.065485 May 17 12:14:52.642083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 388/788] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 17 12:14:52 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/ips => generated 149 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:14:54.240319 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-541bbb90-a27e-41ef-bfe2-e77cdcdda208 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "830964e0-ab37-4b03-908f-7167620acc4d"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:14:54.242183 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-541bbb90-a27e-41ef-bfe2-e77cdcdda208 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:14:54.249374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-541bbb90-a27e-41ef-bfe2-e77cdcdda208 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:54.249832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-541bbb90-a27e-41ef-bfe2-e77cdcdda208 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:54.250613 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-541bbb90-a27e-41ef-bfe2-e77cdcdda208 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:14:54.251055 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-541bbb90-a27e-41ef-bfe2-e77cdcdda208 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:14:54.592109 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-541bbb90-a27e-41ef-bfe2-e77cdcdda208 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358680 May 17 12:14:54.593501 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 401/789] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:14:54 2022] POST /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:02.193989 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8e19f623-f204-44d2-8a53-fb21831928b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "830964e0-ab37-4b03-908f-7167620acc4d"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:02.195056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8e19f623-f204-44d2-8a53-fb21831928b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:02.201727 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8e19f623-f204-44d2-8a53-fb21831928b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:02.202174 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8e19f623-f204-44d2-8a53-fb21831928b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:02.203119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8e19f623-f204-44d2-8a53-fb21831928b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:02.203563 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8e19f623-f204-44d2-8a53-fb21831928b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:02.305413 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-8e19f623-f204-44d2-8a53-fb21831928b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Invalid volume: volume 830964e0-ab37-4b03-908f-7167620acc4d is already attached to instances: e58ca2e7-3e3c-4fa8-a58c-214808748479 May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8e19f623-f204-44d2-8a53-fb21831928b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: POST /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments HTTP/1.1 May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 74 May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:15:02.307017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {"volumeAttachment": {"volumeId": "830964e0-ab37-4b03-908f-7167620acc4d"}} May 17 12:15:02.308529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Invalid volume: volume 830964e0-ab37-4b03-908f-7167620acc4d is already attached to instances: e58ca2e7-3e3c-4fa8-a58c-214808748479 May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'server_id': 'e58ca2e7-3e3c-4fa8-a58c-214808748479', 'body': {'volumeAttachment': {'volumeId': '830964e0-ab37-4b03-908f-7167620acc4d'}}} May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 830964e0-ab37-4b03-908f-7167620acc4d is already attached to instances: e58ca2e7-3e3c-4fa8-a58c-214808748479 May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:15:02.309442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 830964e0-ab37-4b03-908f-7167620acc4d is already attached to instances: e58ca2e7-3e3c-4fa8-a58c-214808748479 May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:15:02.311907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:15:02.314751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:15:02.314751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:15:02.314751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:15:02.314751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 830964e0-ab37-4b03-908f-7167620acc4d is already attached to instances: e58ca2e7-3e3c-4fa8-a58c-214808748479 May 17 12:15:02.314751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:15:02.314751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8e19f623-f204-44d2-8a53-fb21831928b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 400 to user: Invalid volume: volume 830964e0-ab37-4b03-908f-7167620acc4d is already attached to instances: e58ca2e7-3e3c-4fa8-a58c-214808748479 {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:15:02.314751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8e19f623-f204-44d2-8a53-fb21831928b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119208 May 17 12:15:02.314751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 389/790] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:15:02 2022] POST /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 12:15:02.378575 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5b8a6ce4-1ac6-4d20-b956-8519121e7b30 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:02.379158 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5b8a6ce4-1ac6-4d20-b956-8519121e7b30 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:02.386189 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b8a6ce4-1ac6-4d20-b956-8519121e7b30 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:02.386642 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b8a6ce4-1ac6-4d20-b956-8519121e7b30 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:02.387575 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b8a6ce4-1ac6-4d20-b956-8519121e7b30 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:02.388014 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b8a6ce4-1ac6-4d20-b956-8519121e7b30 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:02.512686 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.objects.instance [None req-5b8a6ce4-1ac6-4d20-b956-8519121e7b30 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lazy-loading 'services' on Instance uuid e58ca2e7-3e3c-4fa8-a58c-214808748479 {{(pid=117114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:15:02.630224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5b8a6ce4-1ac6-4d20-b956-8519121e7b30 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments/830964e0-ab37-4b03-908f-7167620acc4d" status: 202 len: 0 microversion: 2.1 time: 0.255792 May 17 12:15:02.631205 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 402/791] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:15:02 2022] DELETE /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments/830964e0-ab37-4b03-908f-7167620acc4d => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:15:02.640420 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8c984b09-85e1-4a9c-a7a1-8508c0f4e301 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:02.641477 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8c984b09-85e1-4a9c-a7a1-8508c0f4e301 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:02.648132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c984b09-85e1-4a9c-a7a1-8508c0f4e301 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:02.648757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c984b09-85e1-4a9c-a7a1-8508c0f4e301 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:02.649652 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c984b09-85e1-4a9c-a7a1-8508c0f4e301 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:02.650198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8c984b09-85e1-4a9c-a7a1-8508c0f4e301 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:02.683952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8c984b09-85e1-4a9c-a7a1-8508c0f4e301 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048578 May 17 12:15:02.684561 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 390/792] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:15:02 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:02.846361 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-dc228850-b828-4104-b68a-f8c2fe811020 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Action: 'create', calling method: .version_select at 0x7f2db4359790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2093136818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElwtHgKy/JVpCVBrG5quus6+APQhpCo8iUWTs71ifG2EyXihKngH6XKavsi7ELMK0hF0hn0wnu9ByuGzB3dBI6luUBrqxdjsR5acv7il+1t58PZ0KpCZISKos8avHFzSg=="}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:02.860449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-dc228850-b828-4104-b68a-f8c2fe811020 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Getting quotas for project 2073530c2a5b4ad4a6543cdfa209c9f0. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:15:02.864521 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-dc228850-b828-4104-b68a-f8c2fe811020 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Getting quotas for user e125d4ed850d49789402a28e4cbb58e1 and project 2073530c2a5b4ad4a6543cdfa209c9f0. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:15:02.885546 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-dc228850-b828-4104-b68a-f8c2fe811020 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.043425 May 17 12:15:02.886135 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 403/793] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 17 12:15:02 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:02.982030 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-217104576", "imageRef": "0d656bb6-d088-4aed-ae2e-e1bf68e18b52", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2093136818", "networks": [{"uuid": "2f753be7-2373-4ef6-8267-57573ca3f74e"}]}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:03.030238 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] validate_networks() for [('2f753be7-2373-4ef6-8267-57573ca3f74e', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:15:03.390188 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:15:03.390790 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:15:03.391079 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:15:03.391518 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:15:03.391933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:15:03.400669 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:03.401119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:03.401955 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:03.402395 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:03.418768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Getting quotas for project 2073530c2a5b4ad4a6543cdfa209c9f0. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:15:03.422622 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Getting quotas for user e125d4ed850d49789402a28e4cbb58e1 and project 2073530c2a5b4ad4a6543cdfa209c9f0. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:15:03.433842 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:15:03.435992 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d656bb6-d088-4aed-ae2e-e1bf68e18b52',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:15:03.481143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a2ac5895-ecb9-45b4-8691-21c2bdf6c2e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503000 May 17 12:15:03.481962 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 391/794] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:15:03.493928 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d2094540-928b-456a-8270-6112948e4048 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:03.494821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d2094540-928b-456a-8270-6112948e4048 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:03.559653 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d2094540-928b-456a-8270-6112948e4048 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:03.567325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d2094540-928b-456a-8270-6112948e4048 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1258 microversion: 2.1 time: 0.079252 May 17 12:15:03.568291 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 404/795] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:03 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:03.695893 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f691eb08-7f1a-4bd8-b036-aeaa0da6a653 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:03.696944 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f691eb08-7f1a-4bd8-b036-aeaa0da6a653 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:03.703910 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f691eb08-7f1a-4bd8-b036-aeaa0da6a653 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:03.704404 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f691eb08-7f1a-4bd8-b036-aeaa0da6a653 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:03.705188 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f691eb08-7f1a-4bd8-b036-aeaa0da6a653 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:03.705629 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f691eb08-7f1a-4bd8-b036-aeaa0da6a653 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:03.735830 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f691eb08-7f1a-4bd8-b036-aeaa0da6a653 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043979 May 17 12:15:03.736568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 392/796] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:15:03 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 12:15:03.799883 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9c7a9fb3-34db-4874-b7ce-c9477d35590c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:03.800552 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9c7a9fb3-34db-4874-b7ce-c9477d35590c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:03.806641 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9c7a9fb3-34db-4874-b7ce-c9477d35590c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:03.807155 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9c7a9fb3-34db-4874-b7ce-c9477d35590c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:03.807991 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9c7a9fb3-34db-4874-b7ce-c9477d35590c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:03.808451 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9c7a9fb3-34db-4874-b7ce-c9477d35590c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:03.836374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9c7a9fb3-34db-4874-b7ce-c9477d35590c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:15:03.915507 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9c7a9fb3-34db-4874-b7ce-c9477d35590c tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 204 len: 0 microversion: 2.1 time: 0.119324 May 17 12:15:03.919232 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 405/797] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:15:03 2022] DELETE /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:15:03.924123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c9f3fcb4-c112-4063-805e-a5f537da48d9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:03.924788 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c9f3fcb4-c112-4063-805e-a5f537da48d9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:03.931113 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c9f3fcb4-c112-4063-805e-a5f537da48d9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:03.931574 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c9f3fcb4-c112-4063-805e-a5f537da48d9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:03.932388 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c9f3fcb4-c112-4063-805e-a5f537da48d9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:03.932828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c9f3fcb4-c112-4063-805e-a5f537da48d9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:04.061424 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c9f3fcb4-c112-4063-805e-a5f537da48d9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:04.068907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c9f3fcb4-c112-4063-805e-a5f537da48d9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1680 microversion: 2.1 time: 0.148564 May 17 12:15:04.069514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 393/798] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:03 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:04.587062 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3c661d8e-9718-4b77-9e14-b9b933752bc1 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:04.587877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3c661d8e-9718-4b77-9e14-b9b933752bc1 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:04.594195 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c661d8e-9718-4b77-9e14-b9b933752bc1 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:04.594644 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c661d8e-9718-4b77-9e14-b9b933752bc1 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:04.595403 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c661d8e-9718-4b77-9e14-b9b933752bc1 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:04.595837 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c661d8e-9718-4b77-9e14-b9b933752bc1 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:04.656900 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3c661d8e-9718-4b77-9e14-b9b933752bc1 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:04.664079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3c661d8e-9718-4b77-9e14-b9b933752bc1 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1254 microversion: 2.1 time: 0.082057 May 17 12:15:04.664672 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 406/799] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:04 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1254 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:05.086529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4b0d1251-3456-4583-b44b-aab247bfac73 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:05.087141 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4b0d1251-3456-4583-b44b-aab247bfac73 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:05.094164 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b0d1251-3456-4583-b44b-aab247bfac73 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:05.094614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b0d1251-3456-4583-b44b-aab247bfac73 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:05.095375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b0d1251-3456-4583-b44b-aab247bfac73 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:05.095808 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4b0d1251-3456-4583-b44b-aab247bfac73 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:05.177215 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a7179db3-f56f-4cc6-b9f9-6b4bf8425556 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:05.177744 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a7179db3-f56f-4cc6-b9f9-6b4bf8425556 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:05.183658 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a7179db3-f56f-4cc6-b9f9-6b4bf8425556 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:05.184104 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a7179db3-f56f-4cc6-b9f9-6b4bf8425556 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:05.184904 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a7179db3-f56f-4cc6-b9f9-6b4bf8425556 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:05.185337 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a7179db3-f56f-4cc6-b9f9-6b4bf8425556 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:05.208526 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a7179db3-f56f-4cc6-b9f9-6b4bf8425556 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/ips" status: 200 len: 151 microversion: 2.20 time: 0.035584 May 17 12:15:05.209102 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 407/800] 10.222.0.58 () {60 vars in 1288 bytes} [Tue May 17 12:15:05 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 12:15:05.226437 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4b0d1251-3456-4583-b44b-aab247bfac73 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:05.233678 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4b0d1251-3456-4583-b44b-aab247bfac73 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1680 microversion: 2.1 time: 0.151275 May 17 12:15:05.234239 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 394/801] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:05 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:05.681138 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a3632c0d-5e88-4a67-a3b0-4e190b82f438 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:05.681788 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a3632c0d-5e88-4a67-a3b0-4e190b82f438 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:05.688268 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a3632c0d-5e88-4a67-a3b0-4e190b82f438 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:05.688720 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a3632c0d-5e88-4a67-a3b0-4e190b82f438 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:05.689489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a3632c0d-5e88-4a67-a3b0-4e190b82f438 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:05.689930 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a3632c0d-5e88-4a67-a3b0-4e190b82f438 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:05.751061 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a3632c0d-5e88-4a67-a3b0-4e190b82f438 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:05.759489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a3632c0d-5e88-4a67-a3b0-4e190b82f438 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1310 microversion: 2.1 time: 0.082145 May 17 12:15:05.760153 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 408/802] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:05 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:06.251035 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e28838dd-b0ad-4c41-8a23-b47b1b27e61d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:06.251617 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e28838dd-b0ad-4c41-8a23-b47b1b27e61d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:06.259425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e28838dd-b0ad-4c41-8a23-b47b1b27e61d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:06.259924 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e28838dd-b0ad-4c41-8a23-b47b1b27e61d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:06.260944 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e28838dd-b0ad-4c41-8a23-b47b1b27e61d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:06.261534 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e28838dd-b0ad-4c41-8a23-b47b1b27e61d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:06.466350 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e28838dd-b0ad-4c41-8a23-b47b1b27e61d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:06.483339 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e28838dd-b0ad-4c41-8a23-b47b1b27e61d tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1680 microversion: 2.1 time: 0.236246 May 17 12:15:06.491048 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 395/803] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:06 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1680 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:06.776538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b968cdee-44df-4f08-be5d-79dc9aa6b2f4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:06.777089 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b968cdee-44df-4f08-be5d-79dc9aa6b2f4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:06.786754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b968cdee-44df-4f08-be5d-79dc9aa6b2f4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:06.787206 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b968cdee-44df-4f08-be5d-79dc9aa6b2f4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:06.788002 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b968cdee-44df-4f08-be5d-79dc9aa6b2f4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:06.788462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b968cdee-44df-4f08-be5d-79dc9aa6b2f4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:07.018611 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a0673756-fb37-4e0f-9664-fce69aa01181 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:07.019160 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a0673756-fb37-4e0f-9664-fce69aa01181 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:07.030471 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a0673756-fb37-4e0f-9664-fce69aa01181 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:07.030858 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a0673756-fb37-4e0f-9664-fce69aa01181 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:07.031675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a0673756-fb37-4e0f-9664-fce69aa01181 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:07.032120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a0673756-fb37-4e0f-9664-fce69aa01181 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:07.083671 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-a0673756-fb37-4e0f-9664-fce69aa01181 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lazy-loading 'flavor' on Instance uuid b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:15:07.171289 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b968cdee-44df-4f08-be5d-79dc9aa6b2f4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:07.180602 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b968cdee-44df-4f08-be5d-79dc9aa6b2f4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.408142 May 17 12:15:07.186050 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 409/804] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:06 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:07.509468 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d50cdd2e-ed60-400c-9690-520b8b43e3fc tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:07.510381 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d50cdd2e-ed60-400c-9690-520b8b43e3fc tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:07.518971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d50cdd2e-ed60-400c-9690-520b8b43e3fc tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:07.520066 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d50cdd2e-ed60-400c-9690-520b8b43e3fc tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:07.521937 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d50cdd2e-ed60-400c-9690-520b8b43e3fc tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:07.522549 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d50cdd2e-ed60-400c-9690-520b8b43e3fc tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:07.665203 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d50cdd2e-ed60-400c-9690-520b8b43e3fc tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:07.680718 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d50cdd2e-ed60-400c-9690-520b8b43e3fc tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1613 microversion: 2.1 time: 0.177353 May 17 12:15:07.695152 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 410/805] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:07 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1613 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:07.704322 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-cab0e347-1c7b-41ca-966d-3901b95c780b req-787d9e17-256f-4071-8a00-295c00c4cf66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58ca2e7-3e3c-4fa8-a58c-214808748479", "name": "network-vif-deleted", "tag": "ee78d37c-d82b-4318-894a-ba9b46ce8870"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:07.716170 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-cab0e347-1c7b-41ca-966d-3901b95c780b req-787d9e17-256f-4071-8a00-295c00c4cf66 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:07.716731 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-cab0e347-1c7b-41ca-966d-3901b95c780b req-787d9e17-256f-4071-8a00-295c00c4cf66 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:07.731099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-cab0e347-1c7b-41ca-966d-3901b95c780b req-787d9e17-256f-4071-8a00-295c00c4cf66 service nova] Creating event network-vif-deleted:ee78d37c-d82b-4318-894a-ba9b46ce8870 for instance e58ca2e7-3e3c-4fa8-a58c-214808748479 on hv-cinder-83769 May 17 12:15:07.737336 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-cab0e347-1c7b-41ca-966d-3901b95c780b req-787d9e17-256f-4071-8a00-295c00c4cf66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039148 May 17 12:15:07.738348 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 411/806] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:07.770016 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a0673756-fb37-4e0f-9664-fce69aa01181 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "POST /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/action" status: 202 len: 0 microversion: 2.20 time: 0.755394 May 17 12:15:07.773975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 396/807] 10.222.0.58 () {62 vars in 1318 bytes} [Tue May 17 12:15:07 2022] POST /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 12:15:07.780847 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-20b29bd6-6cbb-428c-8669-b410c9f47d4a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:07.782133 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-20b29bd6-6cbb-428c-8669-b410c9f47d4a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:07.796335 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20b29bd6-6cbb-428c-8669-b410c9f47d4a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:07.797548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20b29bd6-6cbb-428c-8669-b410c9f47d4a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:07.798631 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20b29bd6-6cbb-428c-8669-b410c9f47d4a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:07.800707 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20b29bd6-6cbb-428c-8669-b410c9f47d4a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:08.066797 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-20b29bd6-6cbb-428c-8669-b410c9f47d4a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:08.084690 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-20b29bd6-6cbb-428c-8669-b410c9f47d4a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:08.088080 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-20b29bd6-6cbb-428c-8669-b410c9f47d4a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:08.090402 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-20b29bd6-6cbb-428c-8669-b410c9f47d4a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.314247 May 17 12:15:08.091615 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 412/808] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:07 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:15:08.208036 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-43cd2ee6-9e40-4671-8af4-276fd6d65b19 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:08.209394 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-43cd2ee6-9e40-4671-8af4-276fd6d65b19 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:08.218703 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-43cd2ee6-9e40-4671-8af4-276fd6d65b19 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:08.219471 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-43cd2ee6-9e40-4671-8af4-276fd6d65b19 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:08.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-43cd2ee6-9e40-4671-8af4-276fd6d65b19 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:08.221049 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-43cd2ee6-9e40-4671-8af4-276fd6d65b19 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:08.478736 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-8ca5a1d9-c1ed-494a-bc04-23865e4fc7c6 req-89817118-69bd-4426-b90d-2264a6816c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70", "tag": "17a6f924-0238-4beb-a7c9-3059b4bb15f8"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:08.491892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-8ca5a1d9-c1ed-494a-bc04-23865e4fc7c6 req-89817118-69bd-4426-b90d-2264a6816c4f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:08.498533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-8ca5a1d9-c1ed-494a-bc04-23865e4fc7c6 req-89817118-69bd-4426-b90d-2264a6816c4f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:08.530905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-8ca5a1d9-c1ed-494a-bc04-23865e4fc7c6 req-89817118-69bd-4426-b90d-2264a6816c4f service nova] Creating event network-changed:17a6f924-0238-4beb-a7c9-3059b4bb15f8 for instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 on hv-cinder-83769 May 17 12:15:08.550067 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-8ca5a1d9-c1ed-494a-bc04-23865e4fc7c6 req-89817118-69bd-4426-b90d-2264a6816c4f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078665 May 17 12:15:08.551550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 413/809] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:08.625632 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-43cd2ee6-9e40-4671-8af4-276fd6d65b19 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:08.634233 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-43cd2ee6-9e40-4671-8af4-276fd6d65b19 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.434683 May 17 12:15:08.637889 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 397/810] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:08 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:08.701977 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-525ab068-4baf-4377-bbb4-48bc71b0ee63 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:08.702681 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-525ab068-4baf-4377-bbb4-48bc71b0ee63 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:08.724758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-525ab068-4baf-4377-bbb4-48bc71b0ee63 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:08.724980 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-525ab068-4baf-4377-bbb4-48bc71b0ee63 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:08.729311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-525ab068-4baf-4377-bbb4-48bc71b0ee63 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:08.730991 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-525ab068-4baf-4377-bbb4-48bc71b0ee63 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:08.833504 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-525ab068-4baf-4377-bbb4-48bc71b0ee63 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:08.841544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-525ab068-4baf-4377-bbb4-48bc71b0ee63 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1326 microversion: 2.1 time: 0.145994 May 17 12:15:08.842351 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 414/811] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:08 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:09.110475 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2f76abd2-aae1-467a-b189-93495978bea5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:09.111276 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2f76abd2-aae1-467a-b189-93495978bea5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:09.118736 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2f76abd2-aae1-467a-b189-93495978bea5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:09.119269 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2f76abd2-aae1-467a-b189-93495978bea5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:09.120063 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2f76abd2-aae1-467a-b189-93495978bea5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:09.120527 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2f76abd2-aae1-467a-b189-93495978bea5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:09.274472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2f76abd2-aae1-467a-b189-93495978bea5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:09.282551 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2f76abd2-aae1-467a-b189-93495978bea5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:09.284151 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2f76abd2-aae1-467a-b189-93495978bea5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:09.285433 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2f76abd2-aae1-467a-b189-93495978bea5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.178921 May 17 12:15:09.286055 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 398/812] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:09 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:09.652707 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7b2a9b7f-e214-4d9c-ba62-87494a9ed570 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:09.653546 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7b2a9b7f-e214-4d9c-ba62-87494a9ed570 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:09.660393 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7b2a9b7f-e214-4d9c-ba62-87494a9ed570 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:09.660954 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7b2a9b7f-e214-4d9c-ba62-87494a9ed570 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:09.661812 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7b2a9b7f-e214-4d9c-ba62-87494a9ed570 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:09.662325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7b2a9b7f-e214-4d9c-ba62-87494a9ed570 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:09.804487 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7b2a9b7f-e214-4d9c-ba62-87494a9ed570 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:09.815379 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7b2a9b7f-e214-4d9c-ba62-87494a9ed570 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.166598 May 17 12:15:09.816389 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 415/813] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:09 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:09.858763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fd036aa2-4b18-4fe7-afc4-0de6b198cad3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:09.859379 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fd036aa2-4b18-4fe7-afc4-0de6b198cad3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:09.865913 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fd036aa2-4b18-4fe7-afc4-0de6b198cad3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:09.866365 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fd036aa2-4b18-4fe7-afc4-0de6b198cad3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:09.867147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fd036aa2-4b18-4fe7-afc4-0de6b198cad3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:09.867592 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fd036aa2-4b18-4fe7-afc4-0de6b198cad3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:09.930308 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-fd036aa2-4b18-4fe7-afc4-0de6b198cad3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:09.938064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fd036aa2-4b18-4fe7-afc4-0de6b198cad3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1326 microversion: 2.1 time: 0.083112 May 17 12:15:09.938716 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 399/814] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:09 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:10.303013 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a85d79c6-627d-4108-8d28-062659f118a7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:10.303713 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a85d79c6-627d-4108-8d28-062659f118a7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:10.310031 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a85d79c6-627d-4108-8d28-062659f118a7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:10.310479 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a85d79c6-627d-4108-8d28-062659f118a7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:10.311266 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a85d79c6-627d-4108-8d28-062659f118a7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:10.311679 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a85d79c6-627d-4108-8d28-062659f118a7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:10.446550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a85d79c6-627d-4108-8d28-062659f118a7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:10.454993 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a85d79c6-627d-4108-8d28-062659f118a7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:10.456511 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a85d79c6-627d-4108-8d28-062659f118a7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:10.457706 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a85d79c6-627d-4108-8d28-062659f118a7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.158740 May 17 12:15:10.458591 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 416/815] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:10 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:10.833478 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d6686a6e-adfd-4924-bf8a-22064df2a19b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:10.834070 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d6686a6e-adfd-4924-bf8a-22064df2a19b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:10.840503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d6686a6e-adfd-4924-bf8a-22064df2a19b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:10.848907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d6686a6e-adfd-4924-bf8a-22064df2a19b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:10.849783 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d6686a6e-adfd-4924-bf8a-22064df2a19b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:10.850231 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d6686a6e-adfd-4924-bf8a-22064df2a19b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:10.957805 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-18c59644-bebc-4f73-8a98-0c8991272670 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:10.958488 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-18c59644-bebc-4f73-8a98-0c8991272670 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:10.964826 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-18c59644-bebc-4f73-8a98-0c8991272670 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:10.965290 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-18c59644-bebc-4f73-8a98-0c8991272670 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:10.966137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-18c59644-bebc-4f73-8a98-0c8991272670 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:10.967033 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-18c59644-bebc-4f73-8a98-0c8991272670 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:10.992240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d6686a6e-adfd-4924-bf8a-22064df2a19b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:11.018885 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d6686a6e-adfd-4924-bf8a-22064df2a19b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.189499 May 17 12:15:11.019509 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 400/816] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:10 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:11.040007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-18c59644-bebc-4f73-8a98-0c8991272670 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:11.047711 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-18c59644-bebc-4f73-8a98-0c8991272670 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1326 microversion: 2.1 time: 0.095001 May 17 12:15:11.053507 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 417/817] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:10 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:11.475906 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d2eb387a-857c-4c23-828e-cfe9f4e0dd46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:11.476565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d2eb387a-857c-4c23-828e-cfe9f4e0dd46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:11.483589 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d2eb387a-857c-4c23-828e-cfe9f4e0dd46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:11.484053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d2eb387a-857c-4c23-828e-cfe9f4e0dd46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:11.484896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d2eb387a-857c-4c23-828e-cfe9f4e0dd46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:11.485384 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d2eb387a-857c-4c23-828e-cfe9f4e0dd46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:11.622371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d2eb387a-857c-4c23-828e-cfe9f4e0dd46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:11.630913 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d2eb387a-857c-4c23-828e-cfe9f4e0dd46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:11.632446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d2eb387a-857c-4c23-828e-cfe9f4e0dd46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:11.633616 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d2eb387a-857c-4c23-828e-cfe9f4e0dd46 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.162559 May 17 12:15:11.634464 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 401/818] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:11 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:12.036659 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e8a593aa-51d6-4f23-8d01-1e86066337ad tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:12.037535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e8a593aa-51d6-4f23-8d01-1e86066337ad tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:12.044080 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8a593aa-51d6-4f23-8d01-1e86066337ad tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:12.044571 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8a593aa-51d6-4f23-8d01-1e86066337ad tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:12.045359 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8a593aa-51d6-4f23-8d01-1e86066337ad tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:12.045805 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8a593aa-51d6-4f23-8d01-1e86066337ad tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:12.065453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c8a7a5ff-1a04-43bb-95d0-1c30fe67cafa tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:12.066132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c8a7a5ff-1a04-43bb-95d0-1c30fe67cafa tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:12.072953 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c8a7a5ff-1a04-43bb-95d0-1c30fe67cafa tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:12.073400 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c8a7a5ff-1a04-43bb-95d0-1c30fe67cafa tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:12.074425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c8a7a5ff-1a04-43bb-95d0-1c30fe67cafa tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:12.074861 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c8a7a5ff-1a04-43bb-95d0-1c30fe67cafa tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:12.142416 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c8a7a5ff-1a04-43bb-95d0-1c30fe67cafa tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:12.150120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c8a7a5ff-1a04-43bb-95d0-1c30fe67cafa tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1326 microversion: 2.1 time: 0.088423 May 17 12:15:12.150703 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 402/819] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:12 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1326 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:12.189447 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e8a593aa-51d6-4f23-8d01-1e86066337ad tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:12.197769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e8a593aa-51d6-4f23-8d01-1e86066337ad tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.165269 May 17 12:15:12.198357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 418/820] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:12 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:12.651995 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7f57f52e-5d4d-4dc8-a97c-f10cc2829366 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:12.652754 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7f57f52e-5d4d-4dc8-a97c-f10cc2829366 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:12.659462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7f57f52e-5d4d-4dc8-a97c-f10cc2829366 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:12.659924 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7f57f52e-5d4d-4dc8-a97c-f10cc2829366 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:12.660741 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7f57f52e-5d4d-4dc8-a97c-f10cc2829366 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:12.661186 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7f57f52e-5d4d-4dc8-a97c-f10cc2829366 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:12.795234 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7f57f52e-5d4d-4dc8-a97c-f10cc2829366 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:12.802894 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7f57f52e-5d4d-4dc8-a97c-f10cc2829366 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:12.804437 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-7f57f52e-5d4d-4dc8-a97c-f10cc2829366 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:12.805597 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7f57f52e-5d4d-4dc8-a97c-f10cc2829366 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.157564 May 17 12:15:12.806164 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 403/821] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:12 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:13.167427 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-354973ab-085a-412f-84cf-a57190f29f5e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:13.168039 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-354973ab-085a-412f-84cf-a57190f29f5e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:13.174422 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-354973ab-085a-412f-84cf-a57190f29f5e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:13.174873 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-354973ab-085a-412f-84cf-a57190f29f5e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:13.175659 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-354973ab-085a-412f-84cf-a57190f29f5e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:13.176093 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-354973ab-085a-412f-84cf-a57190f29f5e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:13.215372 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-253c989a-db6d-42fd-af3d-e4f113a6b457 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:13.215986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-253c989a-db6d-42fd-af3d-e4f113a6b457 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:13.223173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-253c989a-db6d-42fd-af3d-e4f113a6b457 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:13.223623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-253c989a-db6d-42fd-af3d-e4f113a6b457 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:13.224994 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-253c989a-db6d-42fd-af3d-e4f113a6b457 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:13.225627 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-253c989a-db6d-42fd-af3d-e4f113a6b457 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:13.241710 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-354973ab-085a-412f-84cf-a57190f29f5e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:13.249404 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-354973ab-085a-412f-84cf-a57190f29f5e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1326 microversion: 2.1 time: 0.085720 May 17 12:15:13.249982 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 419/822] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:13 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:13.360291 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-253c989a-db6d-42fd-af3d-e4f113a6b457 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:13.370260 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-253c989a-db6d-42fd-af3d-e4f113a6b457 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.158982 May 17 12:15:13.371041 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 404/823] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:13 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:13.823114 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-25d16194-5765-4986-9171-9a3f12b564cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:13.823588 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-25d16194-5765-4986-9171-9a3f12b564cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:13.830256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-25d16194-5765-4986-9171-9a3f12b564cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:13.830704 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-25d16194-5765-4986-9171-9a3f12b564cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:13.831481 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-25d16194-5765-4986-9171-9a3f12b564cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:13.832097 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-25d16194-5765-4986-9171-9a3f12b564cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:13.968027 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-25d16194-5765-4986-9171-9a3f12b564cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:13.976001 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-25d16194-5765-4986-9171-9a3f12b564cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:13.977552 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-25d16194-5765-4986-9171-9a3f12b564cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:13.978732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-25d16194-5765-4986-9171-9a3f12b564cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.159645 May 17 12:15:13.979302 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 420/824] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:13 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:15:14.267094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f02dadf8-9968-4b51-b191-c2bc4048c25e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:14.267705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f02dadf8-9968-4b51-b191-c2bc4048c25e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:14.274324 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f02dadf8-9968-4b51-b191-c2bc4048c25e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:14.274755 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f02dadf8-9968-4b51-b191-c2bc4048c25e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:14.275537 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f02dadf8-9968-4b51-b191-c2bc4048c25e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:14.275970 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f02dadf8-9968-4b51-b191-c2bc4048c25e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:14.340491 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f02dadf8-9968-4b51-b191-c2bc4048c25e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:14.348327 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f02dadf8-9968-4b51-b191-c2bc4048c25e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1326 microversion: 2.1 time: 0.085151 May 17 12:15:14.349105 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 405/825] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:14 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:14.389292 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d54a1eda-8474-4d5c-b08d-dc5b112bfe0d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:14.390134 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d54a1eda-8474-4d5c-b08d-dc5b112bfe0d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:14.396541 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d54a1eda-8474-4d5c-b08d-dc5b112bfe0d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:14.397030 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d54a1eda-8474-4d5c-b08d-dc5b112bfe0d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:14.397790 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d54a1eda-8474-4d5c-b08d-dc5b112bfe0d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:14.398221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d54a1eda-8474-4d5c-b08d-dc5b112bfe0d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:14.560833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d54a1eda-8474-4d5c-b08d-dc5b112bfe0d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:14.570007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d54a1eda-8474-4d5c-b08d-dc5b112bfe0d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.184385 May 17 12:15:14.570600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 421/826] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:14 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:14.996990 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4f46b0c7-90bb-4782-9376-b4995de09d2f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:14.997622 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4f46b0c7-90bb-4782-9376-b4995de09d2f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:15.003976 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4f46b0c7-90bb-4782-9376-b4995de09d2f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:15.004450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4f46b0c7-90bb-4782-9376-b4995de09d2f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:15.005304 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4f46b0c7-90bb-4782-9376-b4995de09d2f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:15.006572 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4f46b0c7-90bb-4782-9376-b4995de09d2f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:15.139262 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4f46b0c7-90bb-4782-9376-b4995de09d2f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:15.148086 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4f46b0c7-90bb-4782-9376-b4995de09d2f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:15.149604 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4f46b0c7-90bb-4782-9376-b4995de09d2f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:15.150777 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4f46b0c7-90bb-4782-9376-b4995de09d2f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.157802 May 17 12:15:15.151450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 406/827] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:14 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:15.366318 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6b2931d7-24f4-4394-9c70-eb9a61a805a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:15.366890 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6b2931d7-24f4-4394-9c70-eb9a61a805a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:15.373043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b2931d7-24f4-4394-9c70-eb9a61a805a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:15.373498 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b2931d7-24f4-4394-9c70-eb9a61a805a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:15.374275 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b2931d7-24f4-4394-9c70-eb9a61a805a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:15.374718 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b2931d7-24f4-4394-9c70-eb9a61a805a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:15.439085 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6b2931d7-24f4-4394-9c70-eb9a61a805a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:15.447815 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6b2931d7-24f4-4394-9c70-eb9a61a805a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1326 microversion: 2.1 time: 0.086058 May 17 12:15:15.448731 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 422/828] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:15 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:15.586989 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-18d9a06c-70eb-4934-8858-2a41ffed4851 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:15.587581 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-18d9a06c-70eb-4934-8858-2a41ffed4851 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:15.594254 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-18d9a06c-70eb-4934-8858-2a41ffed4851 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:15.594710 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-18d9a06c-70eb-4934-8858-2a41ffed4851 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:15.595526 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-18d9a06c-70eb-4934-8858-2a41ffed4851 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:15.595964 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-18d9a06c-70eb-4934-8858-2a41ffed4851 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:15.732202 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-18d9a06c-70eb-4934-8858-2a41ffed4851 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:15.740630 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-18d9a06c-70eb-4934-8858-2a41ffed4851 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.156663 May 17 12:15:15.741479 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 407/829] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:15 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:16.168919 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9f0c8120-08f8-474a-a856-d495a0c40dec tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:16.169638 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9f0c8120-08f8-474a-a856-d495a0c40dec tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:16.175866 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f0c8120-08f8-474a-a856-d495a0c40dec tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:16.176419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f0c8120-08f8-474a-a856-d495a0c40dec tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:16.177255 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f0c8120-08f8-474a-a856-d495a0c40dec tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:16.177768 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f0c8120-08f8-474a-a856-d495a0c40dec tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:16.311919 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9f0c8120-08f8-474a-a856-d495a0c40dec tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:16.320801 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9f0c8120-08f8-474a-a856-d495a0c40dec tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:16.322295 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9f0c8120-08f8-474a-a856-d495a0c40dec tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:16.323465 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9f0c8120-08f8-474a-a856-d495a0c40dec tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.158508 May 17 12:15:16.324023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 423/830] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:16 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:16.465694 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5ddf5ffd-2d77-4a69-894b-8cd4622d38ac tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:16.466335 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5ddf5ffd-2d77-4a69-894b-8cd4622d38ac tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:16.472393 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5ddf5ffd-2d77-4a69-894b-8cd4622d38ac tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:16.472845 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5ddf5ffd-2d77-4a69-894b-8cd4622d38ac tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:16.473619 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5ddf5ffd-2d77-4a69-894b-8cd4622d38ac tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:16.474053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5ddf5ffd-2d77-4a69-894b-8cd4622d38ac tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:16.537357 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5ddf5ffd-2d77-4a69-894b-8cd4622d38ac tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:16.544789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5ddf5ffd-2d77-4a69-894b-8cd4622d38ac tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1326 microversion: 2.1 time: 0.083013 May 17 12:15:16.545357 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 408/831] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:16 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:16.757809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7da38574-3c9a-4a87-9459-c917690e5a84 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:16.758408 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7da38574-3c9a-4a87-9459-c917690e5a84 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:16.764676 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7da38574-3c9a-4a87-9459-c917690e5a84 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:16.765126 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7da38574-3c9a-4a87-9459-c917690e5a84 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:16.765882 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7da38574-3c9a-4a87-9459-c917690e5a84 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:16.766312 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7da38574-3c9a-4a87-9459-c917690e5a84 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:16.892550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7da38574-3c9a-4a87-9459-c917690e5a84 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:16.900489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7da38574-3c9a-4a87-9459-c917690e5a84 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.146552 May 17 12:15:16.901064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 424/832] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:16 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:17.341678 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1b08ef49-f218-4edb-8585-ce1d548f964b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:17.342457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1b08ef49-f218-4edb-8585-ce1d548f964b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:17.348977 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1b08ef49-f218-4edb-8585-ce1d548f964b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:17.350500 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1b08ef49-f218-4edb-8585-ce1d548f964b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:17.351269 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1b08ef49-f218-4edb-8585-ce1d548f964b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:17.351702 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1b08ef49-f218-4edb-8585-ce1d548f964b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:17.479158 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1b08ef49-f218-4edb-8585-ce1d548f964b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:17.487116 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1b08ef49-f218-4edb-8585-ce1d548f964b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:17.488675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1b08ef49-f218-4edb-8585-ce1d548f964b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:17.490386 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1b08ef49-f218-4edb-8585-ce1d548f964b tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.152037 May 17 12:15:17.490954 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 409/833] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:17 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:17.562796 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b6eed193-39c6-4068-a67e-1c456734b898 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:17.563413 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b6eed193-39c6-4068-a67e-1c456734b898 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:17.569943 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b6eed193-39c6-4068-a67e-1c456734b898 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:17.570387 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b6eed193-39c6-4068-a67e-1c456734b898 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:17.571153 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b6eed193-39c6-4068-a67e-1c456734b898 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:17.571583 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b6eed193-39c6-4068-a67e-1c456734b898 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:17.632015 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b6eed193-39c6-4068-a67e-1c456734b898 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:17.639238 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b6eed193-39c6-4068-a67e-1c456734b898 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1326 microversion: 2.1 time: 0.080273 May 17 12:15:17.639805 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 425/834] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:17 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1326 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:17.917518 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a7d6168e-90ab-4ca6-aab9-847fa8c294b0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:17.918137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a7d6168e-90ab-4ca6-aab9-847fa8c294b0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:17.924071 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7d6168e-90ab-4ca6-aab9-847fa8c294b0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:17.924558 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7d6168e-90ab-4ca6-aab9-847fa8c294b0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:17.925355 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7d6168e-90ab-4ca6-aab9-847fa8c294b0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:17.925794 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a7d6168e-90ab-4ca6-aab9-847fa8c294b0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:18.049372 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a7d6168e-90ab-4ca6-aab9-847fa8c294b0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:18.057322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a7d6168e-90ab-4ca6-aab9-847fa8c294b0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.143646 May 17 12:15:18.057899 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 410/835] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:17 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:18.508266 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-87c13873-b7c5-4e49-bacc-1ff9b91f9df5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:18.508871 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-87c13873-b7c5-4e49-bacc-1ff9b91f9df5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:18.515342 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-87c13873-b7c5-4e49-bacc-1ff9b91f9df5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:18.515791 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-87c13873-b7c5-4e49-bacc-1ff9b91f9df5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:18.516582 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-87c13873-b7c5-4e49-bacc-1ff9b91f9df5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:18.517018 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-87c13873-b7c5-4e49-bacc-1ff9b91f9df5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:18.645464 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-87c13873-b7c5-4e49-bacc-1ff9b91f9df5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:18.653655 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-87c13873-b7c5-4e49-bacc-1ff9b91f9df5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:18.655151 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-87c13873-b7c5-4e49-bacc-1ff9b91f9df5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:18.655871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2204f149-bbd2-409a-955b-15926fd834ec tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:18.656451 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-87c13873-b7c5-4e49-bacc-1ff9b91f9df5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.151930 May 17 12:15:18.656604 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2204f149-bbd2-409a-955b-15926fd834ec tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:18.657050 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 426/836] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:18 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:18.663404 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2204f149-bbd2-409a-955b-15926fd834ec tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:18.663854 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2204f149-bbd2-409a-955b-15926fd834ec tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:18.664655 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2204f149-bbd2-409a-955b-15926fd834ec tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:18.665095 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2204f149-bbd2-409a-955b-15926fd834ec tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:18.725336 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2204f149-bbd2-409a-955b-15926fd834ec tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:18.732541 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2204f149-bbd2-409a-955b-15926fd834ec tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1326 microversion: 2.1 time: 0.080400 May 17 12:15:18.733119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 411/837] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:18 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1326 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:19.075142 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8e787b20-aa35-4836-a955-fa1de63b1d42 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:19.075760 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8e787b20-aa35-4836-a955-fa1de63b1d42 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:19.081685 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e787b20-aa35-4836-a955-fa1de63b1d42 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:19.082133 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e787b20-aa35-4836-a955-fa1de63b1d42 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:19.082906 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e787b20-aa35-4836-a955-fa1de63b1d42 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:19.083343 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e787b20-aa35-4836-a955-fa1de63b1d42 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:19.206817 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8e787b20-aa35-4836-a955-fa1de63b1d42 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:19.214095 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8e787b20-aa35-4836-a955-fa1de63b1d42 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.143021 May 17 12:15:19.214660 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 427/838] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:19 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:19.674574 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0eeb6b46-4ff0-4a04-a72c-b37a5fa890e3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:19.675185 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0eeb6b46-4ff0-4a04-a72c-b37a5fa890e3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:19.681668 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0eeb6b46-4ff0-4a04-a72c-b37a5fa890e3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:19.682107 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0eeb6b46-4ff0-4a04-a72c-b37a5fa890e3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:19.682875 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0eeb6b46-4ff0-4a04-a72c-b37a5fa890e3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:19.683309 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0eeb6b46-4ff0-4a04-a72c-b37a5fa890e3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:19.750766 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:19.751537 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:19.758130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:19.758657 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:19.759500 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:19.760004 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:19.793535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:19.793896 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:19.794344 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.objects.instance [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lazy-loading 'fault' on Instance uuid e58ca2e7-3e3c-4fa8-a58c-214808748479 {{(pid=117114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:15:19.823086 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0eeb6b46-4ff0-4a04-a72c-b37a5fa890e3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:19.831717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0eeb6b46-4ff0-4a04-a72c-b37a5fa890e3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:19.833384 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0eeb6b46-4ff0-4a04-a72c-b37a5fa890e3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:19.835267 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0eeb6b46-4ff0-4a04-a72c-b37a5fa890e3 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.164653 May 17 12:15:19.836396 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 412/839] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:19 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:19.843779 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:19.854597 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bf425f8e-de97-4133-bbd3-85465dfacb29 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 200 len: 1331 microversion: 2.1 time: 0.108231 May 17 12:15:19.855190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 428/840] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:19 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:20.231054 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-27693043-6008-4af1-ac05-26bb6335f9b2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:20.231705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-27693043-6008-4af1-ac05-26bb6335f9b2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:20.237803 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-27693043-6008-4af1-ac05-26bb6335f9b2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:20.238248 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-27693043-6008-4af1-ac05-26bb6335f9b2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:20.239025 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-27693043-6008-4af1-ac05-26bb6335f9b2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:20.239466 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-27693043-6008-4af1-ac05-26bb6335f9b2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:20.403598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-27693043-6008-4af1-ac05-26bb6335f9b2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:20.411020 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-27693043-6008-4af1-ac05-26bb6335f9b2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.183900 May 17 12:15:20.413785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 413/841] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:20 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:20.853980 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ea7c41f1-2b11-413f-b7dc-c7efdcbd1733 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:20.854605 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ea7c41f1-2b11-413f-b7dc-c7efdcbd1733 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:20.860886 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ea7c41f1-2b11-413f-b7dc-c7efdcbd1733 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:20.861342 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ea7c41f1-2b11-413f-b7dc-c7efdcbd1733 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:20.862115 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ea7c41f1-2b11-413f-b7dc-c7efdcbd1733 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:20.862557 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ea7c41f1-2b11-413f-b7dc-c7efdcbd1733 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:20.871389 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-979a3c1f-230e-4ffc-9e17-3b0760280795 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:20.872002 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-979a3c1f-230e-4ffc-9e17-3b0760280795 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:20.878376 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-979a3c1f-230e-4ffc-9e17-3b0760280795 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:20.878819 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-979a3c1f-230e-4ffc-9e17-3b0760280795 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:20.879586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-979a3c1f-230e-4ffc-9e17-3b0760280795 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:20.880015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-979a3c1f-230e-4ffc-9e17-3b0760280795 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:20.892880 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-979a3c1f-230e-4ffc-9e17-3b0760280795 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-979a3c1f-230e-4ffc-9e17-3b0760280795 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 HTTP/1.1 May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:15:20.894522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:15:20.896152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'e58ca2e7-3e3c-4fa8-a58c-214808748479'} May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:15:20.897127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:15:20.898633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:15:20.900166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-979a3c1f-230e-4ffc-9e17-3b0760280795 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:15:20.900166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-979a3c1f-230e-4ffc-9e17-3b0760280795 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 404 len: 111 microversion: 2.1 time: 0.028364 May 17 12:15:20.900166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 414/842] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:20 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 12:15:20.904584 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c3ad048d-8dbf-41f1-bda8-266f353a7fdf tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '.version_select at 0x7f2db423e4c0>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:20.922570 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c3ad048d-8dbf-41f1-bda8-266f353a7fdf tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-918379424" status: 202 len: 0 microversion: 2.1 time: 0.021394 May 17 12:15:20.923146 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 415/843] 10.222.0.58 () {58 vars in 1217 bytes} [Tue May 17 12:15:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-918379424 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:15:21.010920 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ea7c41f1-2b11-413f-b7dc-c7efdcbd1733 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:21.019095 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ea7c41f1-2b11-413f-b7dc-c7efdcbd1733 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:21.020645 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ea7c41f1-2b11-413f-b7dc-c7efdcbd1733 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:21.022736 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ea7c41f1-2b11-413f-b7dc-c7efdcbd1733 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.173476 May 17 12:15:21.023378 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 429/844] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:20 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:21.429097 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-542aa9de-d17f-481d-a7fb-5e16d735e654 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:21.429715 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-542aa9de-d17f-481d-a7fb-5e16d735e654 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:21.435458 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-542aa9de-d17f-481d-a7fb-5e16d735e654 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:21.435907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-542aa9de-d17f-481d-a7fb-5e16d735e654 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:21.436696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-542aa9de-d17f-481d-a7fb-5e16d735e654 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:21.437129 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-542aa9de-d17f-481d-a7fb-5e16d735e654 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:21.538811 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-46e19eae-d11b-4469-8244-d5280b203531 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: .version_select at 0x7f2db419da60>, body: {"keypair": {"name": "tempest-keypair-626563116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0Is34/DI5pEa0a7VOla1Mmekc9Kgw7a7f2053/YZBTmHT0zYTAK7N1SUZnkrisINCjVTBi2POkelALUrQQDOfrkZZPmj6R2r0ORznDJPAXZsoe6Z9sipOnzI9SQM//kw=="}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:21.553528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-46e19eae-d11b-4469-8244-d5280b203531 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for project 27acd98621cd4a51ac46fb12e1824168. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:15:21.557365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-46e19eae-d11b-4469-8244-d5280b203531 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for user 586e15d5d16543e6b70c87fbf9079e9e and project 27acd98621cd4a51ac46fb12e1824168. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:15:21.569980 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-542aa9de-d17f-481d-a7fb-5e16d735e654 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:21.578817 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-542aa9de-d17f-481d-a7fb-5e16d735e654 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.153941 May 17 12:15:21.580503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 416/845] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:21 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:21.581899 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-46e19eae-d11b-4469-8244-d5280b203531 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047389 May 17 12:15:21.582628 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 430/846] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 17 12:15:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:15:22.041630 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-46601325-f63e-454b-ba9b-485f78b2ec64 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:22.042352 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-46601325-f63e-454b-ba9b-485f78b2ec64 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:22.049574 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-46601325-f63e-454b-ba9b-485f78b2ec64 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:22.050033 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-46601325-f63e-454b-ba9b-485f78b2ec64 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:22.050800 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-46601325-f63e-454b-ba9b-485f78b2ec64 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:22.051236 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-46601325-f63e-454b-ba9b-485f78b2ec64 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:22.183611 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-46601325-f63e-454b-ba9b-485f78b2ec64 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:22.191425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-46601325-f63e-454b-ba9b-485f78b2ec64 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:22.193502 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-46601325-f63e-454b-ba9b-485f78b2ec64 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:22.194787 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-46601325-f63e-454b-ba9b-485f78b2ec64 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.158054 May 17 12:15:22.195362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 417/847] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:22 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:22.596322 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b1d5a21a-e4cc-4bed-9a1a-6db3200c247d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:22.596972 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b1d5a21a-e4cc-4bed-9a1a-6db3200c247d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:22.604338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1d5a21a-e4cc-4bed-9a1a-6db3200c247d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:22.604645 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1d5a21a-e4cc-4bed-9a1a-6db3200c247d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:22.605501 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1d5a21a-e4cc-4bed-9a1a-6db3200c247d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:22.606022 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b1d5a21a-e4cc-4bed-9a1a-6db3200c247d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:22.814285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b1d5a21a-e4cc-4bed-9a1a-6db3200c247d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:22.821646 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b1d5a21a-e4cc-4bed-9a1a-6db3200c247d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.229758 May 17 12:15:22.822228 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 431/848] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:22 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:22.974253 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1837556763", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ff54b2b-d245-42b7-9e38-b4510eee82b9"}], "security_groups": [{"name": "tempest-securitygroup--1480415854"}], "key_name": "tempest-keypair-626563116", "user_data": "}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:23.069394 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] validate_networks() for [('9ff54b2b-d245-42b7-9e38-b4510eee82b9', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:15:23.213904 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cebc4558-0e28-40dc-8284-bf303437bd99 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:23.214618 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cebc4558-0e28-40dc-8284-bf303437bd99 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:23.220526 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cebc4558-0e28-40dc-8284-bf303437bd99 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:23.220980 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cebc4558-0e28-40dc-8284-bf303437bd99 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:23.221751 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cebc4558-0e28-40dc-8284-bf303437bd99 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:23.222196 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cebc4558-0e28-40dc-8284-bf303437bd99 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:23.349942 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cebc4558-0e28-40dc-8284-bf303437bd99 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:23.358002 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cebc4558-0e28-40dc-8284-bf303437bd99 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:23.359525 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cebc4558-0e28-40dc-8284-bf303437bd99 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:23.360736 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cebc4558-0e28-40dc-8284-bf303437bd99 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.150743 May 17 12:15:23.361305 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 432/849] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:23 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:15:23.435542 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:15:23.435961 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:15:23.436455 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:15:23.436864 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:15:23.437269 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:15:23.446757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:23.447210 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:23.448009 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:23.448507 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:23.464788 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for project 27acd98621cd4a51ac46fb12e1824168. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:15:23.468849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Getting quotas for user 586e15d5d16543e6b70c87fbf9079e9e and project 27acd98621cd4a51ac46fb12e1824168. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:15:23.479849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:15:23.482226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:15:23.528620 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0d16153a-0d0f-47e7-a674-656845a1feca tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.558532 May 17 12:15:23.529455 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 418/850] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:15:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:15:23.539191 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4a7760f4-72a6-40b6-97dc-71d1b93db179 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:23.539814 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4a7760f4-72a6-40b6-97dc-71d1b93db179 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:23.600020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4a7760f4-72a6-40b6-97dc-71d1b93db179 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:23.606556 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4a7760f4-72a6-40b6-97dc-71d1b93db179 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1241 microversion: 2.1 time: 0.071236 May 17 12:15:23.607380 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 433/851] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:23 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:23.838375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-11e4ef4b-3231-4140-b204-7f02d9d49887 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:23.838985 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-11e4ef4b-3231-4140-b204-7f02d9d49887 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:23.846524 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-11e4ef4b-3231-4140-b204-7f02d9d49887 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:23.847072 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-11e4ef4b-3231-4140-b204-7f02d9d49887 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:23.848303 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-11e4ef4b-3231-4140-b204-7f02d9d49887 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:23.849567 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-11e4ef4b-3231-4140-b204-7f02d9d49887 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:23.986293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-11e4ef4b-3231-4140-b204-7f02d9d49887 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:23.994321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-11e4ef4b-3231-4140-b204-7f02d9d49887 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.159843 May 17 12:15:23.995180 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 419/852] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:23 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:24.379347 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c7b3c5e8-4ccd-457f-be49-b045209d5a47 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:24.380006 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c7b3c5e8-4ccd-457f-be49-b045209d5a47 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:24.387677 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c7b3c5e8-4ccd-457f-be49-b045209d5a47 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:24.388136 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c7b3c5e8-4ccd-457f-be49-b045209d5a47 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:24.389020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c7b3c5e8-4ccd-457f-be49-b045209d5a47 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:24.389471 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c7b3c5e8-4ccd-457f-be49-b045209d5a47 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:24.543228 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c7b3c5e8-4ccd-457f-be49-b045209d5a47 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:24.556827 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c7b3c5e8-4ccd-457f-be49-b045209d5a47 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:24.559327 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c7b3c5e8-4ccd-457f-be49-b045209d5a47 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:24.560590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c7b3c5e8-4ccd-457f-be49-b045209d5a47 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.185242 May 17 12:15:24.561506 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 434/853] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:24 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:24.624172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-24237970-0d29-4b20-aaa5-60d0f4f361a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:24.624830 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-24237970-0d29-4b20-aaa5-60d0f4f361a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:24.631344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-24237970-0d29-4b20-aaa5-60d0f4f361a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:24.631794 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-24237970-0d29-4b20-aaa5-60d0f4f361a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:24.632606 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-24237970-0d29-4b20-aaa5-60d0f4f361a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:24.633237 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-24237970-0d29-4b20-aaa5-60d0f4f361a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:24.707620 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-24237970-0d29-4b20-aaa5-60d0f4f361a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:24.715848 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-24237970-0d29-4b20-aaa5-60d0f4f361a5 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1311 microversion: 2.1 time: 0.095456 May 17 12:15:24.716541 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 420/854] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:24 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:25.011403 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-39a9463e-629d-4fae-b9b6-58ec4bc38752 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:25.012024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-39a9463e-629d-4fae-b9b6-58ec4bc38752 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:25.018376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-39a9463e-629d-4fae-b9b6-58ec4bc38752 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:25.018826 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-39a9463e-629d-4fae-b9b6-58ec4bc38752 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:25.019602 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-39a9463e-629d-4fae-b9b6-58ec4bc38752 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:25.020040 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-39a9463e-629d-4fae-b9b6-58ec4bc38752 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:25.147735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-39a9463e-629d-4fae-b9b6-58ec4bc38752 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:25.154903 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-39a9463e-629d-4fae-b9b6-58ec4bc38752 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.147376 May 17 12:15:25.155490 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 435/855] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:25 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:25.578931 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fa4a24ec-8df4-4f82-9efd-ca1e3f5f85ca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:25.580102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fa4a24ec-8df4-4f82-9efd-ca1e3f5f85ca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:25.589780 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fa4a24ec-8df4-4f82-9efd-ca1e3f5f85ca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:25.590113 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fa4a24ec-8df4-4f82-9efd-ca1e3f5f85ca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:25.590899 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fa4a24ec-8df4-4f82-9efd-ca1e3f5f85ca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:25.591529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fa4a24ec-8df4-4f82-9efd-ca1e3f5f85ca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:25.732999 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-03a2b8fe-2bbc-4081-b42f-e17729d33758 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:25.733614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-03a2b8fe-2bbc-4081-b42f-e17729d33758 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:25.739663 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-03a2b8fe-2bbc-4081-b42f-e17729d33758 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:25.740137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-03a2b8fe-2bbc-4081-b42f-e17729d33758 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:25.740942 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-03a2b8fe-2bbc-4081-b42f-e17729d33758 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:25.741377 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-03a2b8fe-2bbc-4081-b42f-e17729d33758 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:25.792597 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-fa4a24ec-8df4-4f82-9efd-ca1e3f5f85ca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:25.801365 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-fa4a24ec-8df4-4f82-9efd-ca1e3f5f85ca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:25.802910 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-fa4a24ec-8df4-4f82-9efd-ca1e3f5f85ca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:25.804087 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fa4a24ec-8df4-4f82-9efd-ca1e3f5f85ca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.229605 May 17 12:15:25.804859 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 421/856] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:25 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:15:25.883548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-03a2b8fe-2bbc-4081-b42f-e17729d33758 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:25.893238 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-03a2b8fe-2bbc-4081-b42f-e17729d33758 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1367 microversion: 2.1 time: 0.164075 May 17 12:15:25.894075 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 436/857] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:25 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:26.105102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-753ed0af-1f52-4166-9f86-61093f7137e8 req-46b42c1a-1ad5-4b27-ae15-abd41554069a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ac4c1c-c934-4d40-9e9a-3378d9537069", "tag": "d332f149-b4a0-45ae-8eb9-e1266bcf6090"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:26.116339 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-753ed0af-1f52-4166-9f86-61093f7137e8 req-46b42c1a-1ad5-4b27-ae15-abd41554069a service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:26.116780 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-753ed0af-1f52-4166-9f86-61093f7137e8 req-46b42c1a-1ad5-4b27-ae15-abd41554069a service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:26.174839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bc55812b-727c-4d24-b719-8a87ed4b7755 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:26.177527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bc55812b-727c-4d24-b719-8a87ed4b7755 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:26.190710 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bc55812b-727c-4d24-b719-8a87ed4b7755 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:26.192311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bc55812b-727c-4d24-b719-8a87ed4b7755 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:26.194535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bc55812b-727c-4d24-b719-8a87ed4b7755 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:26.195303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bc55812b-727c-4d24-b719-8a87ed4b7755 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:26.304125 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-753ed0af-1f52-4166-9f86-61093f7137e8 req-46b42c1a-1ad5-4b27-ae15-abd41554069a service nova] Creating event network-changed:d332f149-b4a0-45ae-8eb9-e1266bcf6090 for instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 on hv-cinder-83769 May 17 12:15:26.310291 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-753ed0af-1f52-4166-9f86-61093f7137e8 req-46b42c1a-1ad5-4b27-ae15-abd41554069a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215196 May 17 12:15:26.311750 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 422/858] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:26.372278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bc55812b-727c-4d24-b719-8a87ed4b7755 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:26.380062 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bc55812b-727c-4d24-b719-8a87ed4b7755 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.211321 May 17 12:15:26.381535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 437/859] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:26 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:26.419946 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-55da4f0f-8156-4452-9dc4-962d69785eae req-09661844-bbde-4804-b24d-b54623fcd4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70", "name": "network-vif-plugged", "status": "completed", "tag": "17a6f924-0238-4beb-a7c9-3059b4bb15f8"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:26.429098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-55da4f0f-8156-4452-9dc4-962d69785eae req-09661844-bbde-4804-b24d-b54623fcd4c7 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:26.429787 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-55da4f0f-8156-4452-9dc4-962d69785eae req-09661844-bbde-4804-b24d-b54623fcd4c7 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:26.441074 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-55da4f0f-8156-4452-9dc4-962d69785eae req-09661844-bbde-4804-b24d-b54623fcd4c7 service nova] Creating event network-vif-plugged:17a6f924-0238-4beb-a7c9-3059b4bb15f8 for instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 on hv-cinder-83769 May 17 12:15:26.446944 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-55da4f0f-8156-4452-9dc4-962d69785eae req-09661844-bbde-4804-b24d-b54623fcd4c7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030818 May 17 12:15:26.447654 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 423/860] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:26.821811 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fdf6046f-5ff5-4f10-86bd-258deb2193cf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:26.822426 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fdf6046f-5ff5-4f10-86bd-258deb2193cf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:26.828644 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fdf6046f-5ff5-4f10-86bd-258deb2193cf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:26.829092 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fdf6046f-5ff5-4f10-86bd-258deb2193cf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:26.829853 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fdf6046f-5ff5-4f10-86bd-258deb2193cf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:26.830284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fdf6046f-5ff5-4f10-86bd-258deb2193cf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:26.912860 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-10cad8bc-6bf5-41cf-8e47-1a8631ad5fe9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:26.913573 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-10cad8bc-6bf5-41cf-8e47-1a8631ad5fe9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:26.919754 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-10cad8bc-6bf5-41cf-8e47-1a8631ad5fe9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:26.920226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-10cad8bc-6bf5-41cf-8e47-1a8631ad5fe9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:26.921011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-10cad8bc-6bf5-41cf-8e47-1a8631ad5fe9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:26.921460 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-10cad8bc-6bf5-41cf-8e47-1a8631ad5fe9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:26.959901 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fdf6046f-5ff5-4f10-86bd-258deb2193cf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:26.968037 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fdf6046f-5ff5-4f10-86bd-258deb2193cf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:26.969595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fdf6046f-5ff5-4f10-86bd-258deb2193cf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:26.970761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fdf6046f-5ff5-4f10-86bd-258deb2193cf tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.152894 May 17 12:15:26.971341 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 438/861] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:26 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:27.049323 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-10cad8bc-6bf5-41cf-8e47-1a8631ad5fe9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:27.056736 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-10cad8bc-6bf5-41cf-8e47-1a8631ad5fe9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1367 microversion: 2.1 time: 0.149463 May 17 12:15:27.057299 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 424/862] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:26 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:27.398310 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ad84c220-4c2c-48d9-a1c5-9a696bd8fbea tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:27.398934 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ad84c220-4c2c-48d9-a1c5-9a696bd8fbea tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:27.405314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad84c220-4c2c-48d9-a1c5-9a696bd8fbea tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:27.405765 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad84c220-4c2c-48d9-a1c5-9a696bd8fbea tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:27.406533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad84c220-4c2c-48d9-a1c5-9a696bd8fbea tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:27.406971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ad84c220-4c2c-48d9-a1c5-9a696bd8fbea tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:27.532824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ad84c220-4c2c-48d9-a1c5-9a696bd8fbea tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:27.540205 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ad84c220-4c2c-48d9-a1c5-9a696bd8fbea tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.146443 May 17 12:15:27.540782 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 439/863] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:27 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:27.989281 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-36066819-8ed9-4492-930e-4fcce56ef562 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:27.990383 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-36066819-8ed9-4492-930e-4fcce56ef562 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:27.996689 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-36066819-8ed9-4492-930e-4fcce56ef562 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:27.997145 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-36066819-8ed9-4492-930e-4fcce56ef562 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:27.997913 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-36066819-8ed9-4492-930e-4fcce56ef562 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:27.998349 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-36066819-8ed9-4492-930e-4fcce56ef562 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:28.074974 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-729f06ea-811c-485b-9db6-064e9d69b253 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:28.075571 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-729f06ea-811c-485b-9db6-064e9d69b253 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:28.081427 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-729f06ea-811c-485b-9db6-064e9d69b253 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:28.081911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-729f06ea-811c-485b-9db6-064e9d69b253 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:28.082676 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-729f06ea-811c-485b-9db6-064e9d69b253 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:28.083112 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-729f06ea-811c-485b-9db6-064e9d69b253 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:28.124698 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-36066819-8ed9-4492-930e-4fcce56ef562 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:28.133086 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-36066819-8ed9-4492-930e-4fcce56ef562 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:28.134576 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-36066819-8ed9-4492-930e-4fcce56ef562 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:28.135720 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-36066819-8ed9-4492-930e-4fcce56ef562 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.150405 May 17 12:15:28.136284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 425/864] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:27 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:28.208473 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-729f06ea-811c-485b-9db6-064e9d69b253 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:28.215610 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-729f06ea-811c-485b-9db6-064e9d69b253 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1367 microversion: 2.1 time: 0.144796 May 17 12:15:28.216195 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 440/865] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:28 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:28.556808 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5d127d1f-25f4-4025-98e2-3fb0d2fb6b4a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:28.557429 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5d127d1f-25f4-4025-98e2-3fb0d2fb6b4a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:28.563365 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5d127d1f-25f4-4025-98e2-3fb0d2fb6b4a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:28.563815 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5d127d1f-25f4-4025-98e2-3fb0d2fb6b4a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:28.564639 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5d127d1f-25f4-4025-98e2-3fb0d2fb6b4a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:28.565081 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5d127d1f-25f4-4025-98e2-3fb0d2fb6b4a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:28.693887 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5d127d1f-25f4-4025-98e2-3fb0d2fb6b4a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:28.701344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5d127d1f-25f4-4025-98e2-3fb0d2fb6b4a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.148364 May 17 12:15:28.701908 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 426/866] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:28 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:29.153642 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-90f2c721-dfb3-4325-8e9c-cf6ce9b50bfb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:29.154284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-90f2c721-dfb3-4325-8e9c-cf6ce9b50bfb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:29.160626 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90f2c721-dfb3-4325-8e9c-cf6ce9b50bfb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:29.161074 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90f2c721-dfb3-4325-8e9c-cf6ce9b50bfb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:29.161996 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90f2c721-dfb3-4325-8e9c-cf6ce9b50bfb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:29.162440 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-90f2c721-dfb3-4325-8e9c-cf6ce9b50bfb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:29.232763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d81ebd23-d338-4ac8-88a3-3e7c1f7f39b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:29.233487 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d81ebd23-d338-4ac8-88a3-3e7c1f7f39b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:29.240451 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d81ebd23-d338-4ac8-88a3-3e7c1f7f39b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:29.240915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d81ebd23-d338-4ac8-88a3-3e7c1f7f39b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:29.241695 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d81ebd23-d338-4ac8-88a3-3e7c1f7f39b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:29.242143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d81ebd23-d338-4ac8-88a3-3e7c1f7f39b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:29.360281 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-90f2c721-dfb3-4325-8e9c-cf6ce9b50bfb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:29.369198 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-90f2c721-dfb3-4325-8e9c-cf6ce9b50bfb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:29.369380 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d81ebd23-d338-4ac8-88a3-3e7c1f7f39b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:29.370801 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-90f2c721-dfb3-4325-8e9c-cf6ce9b50bfb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:29.371985 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-90f2c721-dfb3-4325-8e9c-cf6ce9b50bfb tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.222386 May 17 12:15:29.372580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 441/867] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:29 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:29.376867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d81ebd23-d338-4ac8-88a3-3e7c1f7f39b1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1367 microversion: 2.1 time: 0.147937 May 17 12:15:29.377443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 427/868] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:29 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:29.718714 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a8b9b554-6606-4d69-bcff-b7119090356a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:29.719627 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a8b9b554-6606-4d69-bcff-b7119090356a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:29.726172 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a8b9b554-6606-4d69-bcff-b7119090356a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:29.726620 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a8b9b554-6606-4d69-bcff-b7119090356a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:29.727391 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a8b9b554-6606-4d69-bcff-b7119090356a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:29.727831 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a8b9b554-6606-4d69-bcff-b7119090356a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:29.857657 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a8b9b554-6606-4d69-bcff-b7119090356a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:29.865374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a8b9b554-6606-4d69-bcff-b7119090356a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1358 microversion: 2.1 time: 0.149967 May 17 12:15:29.865939 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 442/869] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:29 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:30.394064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3c8b7f41-2f0e-4e48-9a85-d40ddd66a248 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:30.394591 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4fd645c3-8fcd-48be-969b-2f84d9f9b375 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:30.394979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-3c8b7f41-2f0e-4e48-9a85-d40ddd66a248 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:30.395087 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4fd645c3-8fcd-48be-969b-2f84d9f9b375 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:30.401903 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3c8b7f41-2f0e-4e48-9a85-d40ddd66a248 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:30.402046 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4fd645c3-8fcd-48be-969b-2f84d9f9b375 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:30.402360 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3c8b7f41-2f0e-4e48-9a85-d40ddd66a248 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:30.402474 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4fd645c3-8fcd-48be-969b-2f84d9f9b375 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:30.403137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3c8b7f41-2f0e-4e48-9a85-d40ddd66a248 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:30.403284 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4fd645c3-8fcd-48be-969b-2f84d9f9b375 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:30.403872 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3c8b7f41-2f0e-4e48-9a85-d40ddd66a248 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:30.404268 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4fd645c3-8fcd-48be-969b-2f84d9f9b375 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:30.539631 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4fd645c3-8fcd-48be-969b-2f84d9f9b375 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:30.542298 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3c8b7f41-2f0e-4e48-9a85-d40ddd66a248 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:30.547578 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4fd645c3-8fcd-48be-969b-2f84d9f9b375 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:30.549102 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4fd645c3-8fcd-48be-969b-2f84d9f9b375 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:30.549509 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-3c8b7f41-2f0e-4e48-9a85-d40ddd66a248 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1367 microversion: 2.1 time: 0.159377 May 17 12:15:30.550083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 428/870] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:30 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:30.550303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4fd645c3-8fcd-48be-969b-2f84d9f9b375 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.159565 May 17 12:15:30.550839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 443/871] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:30 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:15:30.890694 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d027c73d-e360-4749-82e0-f9f342fda161 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:30.891638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d027c73d-e360-4749-82e0-f9f342fda161 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:30.897855 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d027c73d-e360-4749-82e0-f9f342fda161 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:30.898309 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d027c73d-e360-4749-82e0-f9f342fda161 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:30.899118 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d027c73d-e360-4749-82e0-f9f342fda161 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:30.899535 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d027c73d-e360-4749-82e0-f9f342fda161 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.029705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d027c73d-e360-4749-82e0-f9f342fda161 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:31.037621 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d027c73d-e360-4749-82e0-f9f342fda161 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1548 microversion: 2.1 time: 0.159236 May 17 12:15:31.038189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 429/872] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:30 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:31.053515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-aa2314b1-8015-47c5-a5db-2374b22a7b88 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:31.054137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-aa2314b1-8015-47c5-a5db-2374b22a7b88 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:31.059982 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aa2314b1-8015-47c5-a5db-2374b22a7b88 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:31.060466 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aa2314b1-8015-47c5-a5db-2374b22a7b88 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.061257 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aa2314b1-8015-47c5-a5db-2374b22a7b88 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:31.061675 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aa2314b1-8015-47c5-a5db-2374b22a7b88 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.270286 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-aa2314b1-8015-47c5-a5db-2374b22a7b88 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:31.278330 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-aa2314b1-8015-47c5-a5db-2374b22a7b88 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1548 microversion: 2.1 time: 0.228536 May 17 12:15:31.278905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 444/873] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:31 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1548 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:31.294090 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-891fbb22-a714-4430-a128-0007f7f47623 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:31.297522 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-891fbb22-a714-4430-a128-0007f7f47623 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:31.298287 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-891fbb22-a714-4430-a128-0007f7f47623 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Searching by: {'deleted': False, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0'} {{(pid=117113) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 17 12:15:31.305305 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-891fbb22-a714-4430-a128-0007f7f47623 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:31.305759 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-891fbb22-a714-4430-a128-0007f7f47623 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.306941 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-891fbb22-a714-4430-a128-0007f7f47623 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:31.307071 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-891fbb22-a714-4430-a128-0007f7f47623 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.402050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.multi_cell_list [None req-891fbb22-a714-4430-a128-0007f7f47623 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117113) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 17 12:15:31.501613 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-891fbb22-a714-4430-a128-0007f7f47623 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211061 May 17 12:15:31.502120 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 430/874] 10.222.0.58 () {58 vars in 1124 bytes} [Tue May 17 12:15:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:31.513037 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9196e88c-3b7c-4184-9207-d6c89cc5ead0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:31.513661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9196e88c-3b7c-4184-9207-d6c89cc5ead0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:31.520203 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9196e88c-3b7c-4184-9207-d6c89cc5ead0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:31.520662 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9196e88c-3b7c-4184-9207-d6c89cc5ead0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.521447 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9196e88c-3b7c-4184-9207-d6c89cc5ead0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:31.521984 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9196e88c-3b7c-4184-9207-d6c89cc5ead0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.565789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-58a479f1-9799-45ef-99f0-2c17ef4f9cc1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:31.566414 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-58a479f1-9799-45ef-99f0-2c17ef4f9cc1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:31.573159 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-58a479f1-9799-45ef-99f0-2c17ef4f9cc1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:31.573615 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-58a479f1-9799-45ef-99f0-2c17ef4f9cc1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.574649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-58a479f1-9799-45ef-99f0-2c17ef4f9cc1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:31.575088 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-58a479f1-9799-45ef-99f0-2c17ef4f9cc1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.706282 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-58a479f1-9799-45ef-99f0-2c17ef4f9cc1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:31.715294 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-58a479f1-9799-45ef-99f0-2c17ef4f9cc1 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1367 microversion: 2.1 time: 0.153357 May 17 12:15:31.719152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 431/875] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:31 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:31.720805 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-17707772-5733-448e-a797-3cf323ff00a4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:31.721564 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-17707772-5733-448e-a797-3cf323ff00a4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:31.722924 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-9196e88c-3b7c-4184-9207-d6c89cc5ead0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:31.729811 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17707772-5733-448e-a797-3cf323ff00a4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:31.730478 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17707772-5733-448e-a797-3cf323ff00a4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.731453 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9196e88c-3b7c-4184-9207-d6c89cc5ead0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1548 microversion: 2.1 time: 0.222195 May 17 12:15:31.731609 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17707772-5733-448e-a797-3cf323ff00a4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:31.732086 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17707772-5733-448e-a797-3cf323ff00a4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:31.732314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 445/876] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:31 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1548 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:31.860325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-17707772-5733-448e-a797-3cf323ff00a4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:31.868473 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-17707772-5733-448e-a797-3cf323ff00a4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:31.870321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-17707772-5733-448e-a797-3cf323ff00a4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:31.871639 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-17707772-5733-448e-a797-3cf323ff00a4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.154474 May 17 12:15:31.872281 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 432/877] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:31 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:32.414156 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-ff49fa4f-391b-4004-999e-ed6f3a12ac36 req-cae6eded-0f79-48ca-88b2-2df0e65f5d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ac4c1c-c934-4d40-9e9a-3378d9537069", "name": "network-vif-plugged", "status": "completed", "tag": "d332f149-b4a0-45ae-8eb9-e1266bcf6090"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:32.422180 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-ff49fa4f-391b-4004-999e-ed6f3a12ac36 req-cae6eded-0f79-48ca-88b2-2df0e65f5d73 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:32.422628 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-ff49fa4f-391b-4004-999e-ed6f3a12ac36 req-cae6eded-0f79-48ca-88b2-2df0e65f5d73 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:32.434241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-ff49fa4f-391b-4004-999e-ed6f3a12ac36 req-cae6eded-0f79-48ca-88b2-2df0e65f5d73 service nova] Creating event network-vif-plugged:d332f149-b4a0-45ae-8eb9-e1266bcf6090 for instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 on hv-cinder-83769 May 17 12:15:32.439054 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-ff49fa4f-391b-4004-999e-ed6f3a12ac36 req-cae6eded-0f79-48ca-88b2-2df0e65f5d73 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029163 May 17 12:15:32.439655 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 446/878] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:32.733039 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0f3a128b-54e3-438f-8126-1665c09331b8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:32.733672 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0f3a128b-54e3-438f-8126-1665c09331b8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:32.740132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0f3a128b-54e3-438f-8126-1665c09331b8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:32.740622 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0f3a128b-54e3-438f-8126-1665c09331b8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:32.741400 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0f3a128b-54e3-438f-8126-1665c09331b8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:32.741840 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0f3a128b-54e3-438f-8126-1665c09331b8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:32.870496 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0f3a128b-54e3-438f-8126-1665c09331b8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:32.877721 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0f3a128b-54e3-438f-8126-1665c09331b8 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1367 microversion: 2.1 time: 0.148545 May 17 12:15:32.878291 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 433/879] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:32 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:32.891208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8700f421-e74c-414b-9df5-6f170d4bf1a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:32.891912 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8700f421-e74c-414b-9df5-6f170d4bf1a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:32.898661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8700f421-e74c-414b-9df5-6f170d4bf1a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:32.899124 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8700f421-e74c-414b-9df5-6f170d4bf1a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:32.899896 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8700f421-e74c-414b-9df5-6f170d4bf1a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:32.900441 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8700f421-e74c-414b-9df5-6f170d4bf1a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:33.026636 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8700f421-e74c-414b-9df5-6f170d4bf1a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:33.034531 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8700f421-e74c-414b-9df5-6f170d4bf1a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:33.036048 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8700f421-e74c-414b-9df5-6f170d4bf1a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:33.037888 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8700f421-e74c-414b-9df5-6f170d4bf1a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.150859 May 17 12:15:33.038676 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 447/880] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:32 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:33.228663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7f3480aa-e71d-4cf2-a53a-fb6b7218116c tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33198abe-dba7-47bb-8940-fd5e9140232e"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:33.229906 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7f3480aa-e71d-4cf2-a53a-fb6b7218116c tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:33.235737 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7f3480aa-e71d-4cf2-a53a-fb6b7218116c tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:33.236313 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7f3480aa-e71d-4cf2-a53a-fb6b7218116c tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:33.237177 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7f3480aa-e71d-4cf2-a53a-fb6b7218116c tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:33.237618 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7f3480aa-e71d-4cf2-a53a-fb6b7218116c tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:33.894944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-72e77369-daab-41c2-9d26-def02a7cbddd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:33.895563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-72e77369-daab-41c2-9d26-def02a7cbddd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:33.898845 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7f3480aa-e71d-4cf2-a53a-fb6b7218116c tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "POST /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674017 May 17 12:15:33.899831 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 434/881] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:15:33 2022] POST /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:33.902675 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-72e77369-daab-41c2-9d26-def02a7cbddd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:33.903070 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-72e77369-daab-41c2-9d26-def02a7cbddd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:33.908240 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-72e77369-daab-41c2-9d26-def02a7cbddd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:33.908240 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-72e77369-daab-41c2-9d26-def02a7cbddd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:34.036900 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-72e77369-daab-41c2-9d26-def02a7cbddd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:34.044831 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-72e77369-daab-41c2-9d26-def02a7cbddd tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1367 microversion: 2.1 time: 0.153909 May 17 12:15:34.045399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 448/882] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:33 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:15:34.056017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-17dc9ad4-9563-4685-8c33-c8b826d6c81a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:34.056698 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-17dc9ad4-9563-4685-8c33-c8b826d6c81a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:34.062880 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17dc9ad4-9563-4685-8c33-c8b826d6c81a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:34.063340 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17dc9ad4-9563-4685-8c33-c8b826d6c81a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:34.064110 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17dc9ad4-9563-4685-8c33-c8b826d6c81a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:34.064599 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-17dc9ad4-9563-4685-8c33-c8b826d6c81a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:34.194844 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-17dc9ad4-9563-4685-8c33-c8b826d6c81a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:34.202952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-17dc9ad4-9563-4685-8c33-c8b826d6c81a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:34.204505 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-17dc9ad4-9563-4685-8c33-c8b826d6c81a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:34.205713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-17dc9ad4-9563-4685-8c33-c8b826d6c81a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.154497 May 17 12:15:34.206279 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 435/883] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:34 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:35.063021 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-35fe4ebd-38d2-4880-b925-f98a4738c941 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:35.063658 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-35fe4ebd-38d2-4880-b925-f98a4738c941 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:35.070839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-35fe4ebd-38d2-4880-b925-f98a4738c941 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:35.071297 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-35fe4ebd-38d2-4880-b925-f98a4738c941 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:35.072080 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-35fe4ebd-38d2-4880-b925-f98a4738c941 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:35.072556 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-35fe4ebd-38d2-4880-b925-f98a4738c941 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:35.199055 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-35fe4ebd-38d2-4880-b925-f98a4738c941 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:35.206755 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-35fe4ebd-38d2-4880-b925-f98a4738c941 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1556 microversion: 2.1 time: 0.148468 May 17 12:15:35.207332 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 449/884] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:35 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:35.223612 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0f8ab04a-160d-460f-8241-465d4c00c612 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:35.224107 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0f8ab04a-160d-460f-8241-465d4c00c612 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:35.224931 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-c17ba334-2515-4bcd-acd9-1104ddff9052 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:35.225548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-c17ba334-2515-4bcd-acd9-1104ddff9052 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:35.230496 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0f8ab04a-160d-460f-8241-465d4c00c612 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:35.230958 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0f8ab04a-160d-460f-8241-465d4c00c612 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:35.231281 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c17ba334-2515-4bcd-acd9-1104ddff9052 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:35.231725 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c17ba334-2515-4bcd-acd9-1104ddff9052 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:35.231837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0f8ab04a-160d-460f-8241-465d4c00c612 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:35.232193 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0f8ab04a-160d-460f-8241-465d4c00c612 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:35.232547 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c17ba334-2515-4bcd-acd9-1104ddff9052 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:35.232980 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-c17ba334-2515-4bcd-acd9-1104ddff9052 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:35.309578 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0f8ab04a-160d-460f-8241-465d4c00c612 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090053 May 17 12:15:35.310184 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 436/885] 10.222.0.58 () {58 vars in 1274 bytes} [Tue May 17 12:15:35 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:35.456889 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c17ba334-2515-4bcd-acd9-1104ddff9052 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:35.465031 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c17ba334-2515-4bcd-acd9-1104ddff9052 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:35.466533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-c17ba334-2515-4bcd-acd9-1104ddff9052 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:35.467691 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-c17ba334-2515-4bcd-acd9-1104ddff9052 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.246584 May 17 12:15:35.468280 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 450/886] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:35 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:15:36.232004 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-010c84a4-3759-4fc1-a67d-55e33b621d71 req-7ac4b591-a596-49c3-ab66-07e8677f35b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ac4c1c-c934-4d40-9e9a-3378d9537069", "tag": "d332f149-b4a0-45ae-8eb9-e1266bcf6090"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:36.239991 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-010c84a4-3759-4fc1-a67d-55e33b621d71 req-7ac4b591-a596-49c3-ab66-07e8677f35b1 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:36.240950 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-010c84a4-3759-4fc1-a67d-55e33b621d71 req-7ac4b591-a596-49c3-ab66-07e8677f35b1 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:36.253705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-010c84a4-3759-4fc1-a67d-55e33b621d71 req-7ac4b591-a596-49c3-ab66-07e8677f35b1 service nova] Creating event network-changed:d332f149-b4a0-45ae-8eb9-e1266bcf6090 for instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 on hv-cinder-83769 May 17 12:15:36.259177 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-010c84a4-3759-4fc1-a67d-55e33b621d71 req-7ac4b591-a596-49c3-ab66-07e8677f35b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031277 May 17 12:15:36.259806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 437/887] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:36.485926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-77ecb0de-36a7-4661-933d-2f1143425985 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:36.487145 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-77ecb0de-36a7-4661-933d-2f1143425985 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:36.494851 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-77ecb0de-36a7-4661-933d-2f1143425985 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:36.495567 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-77ecb0de-36a7-4661-933d-2f1143425985 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:36.496575 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-77ecb0de-36a7-4661-933d-2f1143425985 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:36.497007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-77ecb0de-36a7-4661-933d-2f1143425985 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:36.678576 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-77ecb0de-36a7-4661-933d-2f1143425985 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:36.686771 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-77ecb0de-36a7-4661-933d-2f1143425985 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:36.688476 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-77ecb0de-36a7-4661-933d-2f1143425985 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:36.689923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-77ecb0de-36a7-4661-933d-2f1143425985 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.207860 May 17 12:15:36.690499 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 451/888] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:36 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:37.709621 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c6a965ea-c7ae-48fb-ac5a-6d7dfdd81881 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:37.710316 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c6a965ea-c7ae-48fb-ac5a-6d7dfdd81881 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:37.716883 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c6a965ea-c7ae-48fb-ac5a-6d7dfdd81881 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:37.717329 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c6a965ea-c7ae-48fb-ac5a-6d7dfdd81881 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:37.718094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c6a965ea-c7ae-48fb-ac5a-6d7dfdd81881 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:37.718530 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c6a965ea-c7ae-48fb-ac5a-6d7dfdd81881 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:37.848396 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c6a965ea-c7ae-48fb-ac5a-6d7dfdd81881 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:37.856664 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c6a965ea-c7ae-48fb-ac5a-6d7dfdd81881 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:37.858168 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c6a965ea-c7ae-48fb-ac5a-6d7dfdd81881 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:37.859327 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c6a965ea-c7ae-48fb-ac5a-6d7dfdd81881 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1743 microversion: 2.20 time: 0.154310 May 17 12:15:37.859889 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 438/889] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:37 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:38.877812 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4f538d7b-7e48-42e0-bfe5-f60397782901 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:38.878450 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4f538d7b-7e48-42e0-bfe5-f60397782901 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:38.885385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f538d7b-7e48-42e0-bfe5-f60397782901 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:38.885832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f538d7b-7e48-42e0-bfe5-f60397782901 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:38.886589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f538d7b-7e48-42e0-bfe5-f60397782901 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:38.887023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f538d7b-7e48-42e0-bfe5-f60397782901 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:39.014526 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4f538d7b-7e48-42e0-bfe5-f60397782901 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:39.022338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4f538d7b-7e48-42e0-bfe5-f60397782901 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:39.023828 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4f538d7b-7e48-42e0-bfe5-f60397782901 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:39.025000 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4f538d7b-7e48-42e0-bfe5-f60397782901 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1743 microversion: 2.20 time: 0.151087 May 17 12:15:39.025568 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 452/890] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:38 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:40.043301 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a6dc53c6-73bd-416c-8e7d-317ee085165a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:40.043917 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a6dc53c6-73bd-416c-8e7d-317ee085165a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:40.050446 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a6dc53c6-73bd-416c-8e7d-317ee085165a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:40.051009 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a6dc53c6-73bd-416c-8e7d-317ee085165a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:40.051867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a6dc53c6-73bd-416c-8e7d-317ee085165a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:40.052487 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a6dc53c6-73bd-416c-8e7d-317ee085165a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:40.190188 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a6dc53c6-73bd-416c-8e7d-317ee085165a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:40.198550 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a6dc53c6-73bd-416c-8e7d-317ee085165a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:40.200490 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a6dc53c6-73bd-416c-8e7d-317ee085165a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:40.201735 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a6dc53c6-73bd-416c-8e7d-317ee085165a tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1743 microversion: 2.20 time: 0.162415 May 17 12:15:40.202297 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 439/891] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:40 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:40.451224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-dd23e99d-b3e7-4507-982d-fff28a702ea8 req-138adc4e-486d-4660-a1a1-8e305e99209c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23", "name": "network-vif-plugged", "status": "completed", "tag": "3370c5ba-e7d7-4dab-8520-7a3da90d8b4a"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:40.460466 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-dd23e99d-b3e7-4507-982d-fff28a702ea8 req-138adc4e-486d-4660-a1a1-8e305e99209c service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:40.460861 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-dd23e99d-b3e7-4507-982d-fff28a702ea8 req-138adc4e-486d-4660-a1a1-8e305e99209c service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:40.471922 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-dd23e99d-b3e7-4507-982d-fff28a702ea8 req-138adc4e-486d-4660-a1a1-8e305e99209c service nova] Creating event network-vif-plugged:3370c5ba-e7d7-4dab-8520-7a3da90d8b4a for instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 on hv-cinder-83769 May 17 12:15:40.476889 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-dd23e99d-b3e7-4507-982d-fff28a702ea8 req-138adc4e-486d-4660-a1a1-8e305e99209c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029589 May 17 12:15:40.477502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 453/892] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:41.220579 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ca84d550-f5c1-491e-9c70-6e9327db51b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:41.221209 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ca84d550-f5c1-491e-9c70-6e9327db51b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:41.227526 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca84d550-f5c1-491e-9c70-6e9327db51b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:41.228012 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca84d550-f5c1-491e-9c70-6e9327db51b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:41.228816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca84d550-f5c1-491e-9c70-6e9327db51b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:41.229261 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ca84d550-f5c1-491e-9c70-6e9327db51b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:41.359487 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ca84d550-f5c1-491e-9c70-6e9327db51b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:41.368411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ca84d550-f5c1-491e-9c70-6e9327db51b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:41.369949 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ca84d550-f5c1-491e-9c70-6e9327db51b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:41.371123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ca84d550-f5c1-491e-9c70-6e9327db51b9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1743 microversion: 2.20 time: 0.154536 May 17 12:15:41.371690 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 440/893] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:41 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:42.391749 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1a0290f4-5765-496a-a871-6051f2c43d50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:42.393249 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1a0290f4-5765-496a-a871-6051f2c43d50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:42.400253 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1a0290f4-5765-496a-a871-6051f2c43d50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:42.400851 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1a0290f4-5765-496a-a871-6051f2c43d50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:42.401885 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1a0290f4-5765-496a-a871-6051f2c43d50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:42.402536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1a0290f4-5765-496a-a871-6051f2c43d50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:42.535532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-65ccbe1b-3784-4eef-8158-db823a8e8de4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:42.535532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-65ccbe1b-3784-4eef-8158-db823a8e8de4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:42.543361 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-65ccbe1b-3784-4eef-8158-db823a8e8de4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:42.543810 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-65ccbe1b-3784-4eef-8158-db823a8e8de4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:42.544653 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-65ccbe1b-3784-4eef-8158-db823a8e8de4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:42.545281 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-65ccbe1b-3784-4eef-8158-db823a8e8de4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:42.573163 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1a0290f4-5765-496a-a871-6051f2c43d50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:42.582656 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1a0290f4-5765-496a-a871-6051f2c43d50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:42.585732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1a0290f4-5765-496a-a871-6051f2c43d50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:42.590360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1a0290f4-5765-496a-a871-6051f2c43d50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1738 microversion: 2.20 time: 0.200499 May 17 12:15:42.591807 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 454/894] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:42 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:42.709796 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-65ccbe1b-3784-4eef-8158-db823a8e8de4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:42.718106 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-65ccbe1b-3784-4eef-8158-db823a8e8de4 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1594 microversion: 2.1 time: 0.198475 May 17 12:15:42.719123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 441/895] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:42 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1594 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:43.609488 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1366c827-c7c1-4482-8bdf-0ca752f87958 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:43.610113 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1366c827-c7c1-4482-8bdf-0ca752f87958 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:43.617839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1366c827-c7c1-4482-8bdf-0ca752f87958 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:43.618291 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1366c827-c7c1-4482-8bdf-0ca752f87958 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:43.619073 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1366c827-c7c1-4482-8bdf-0ca752f87958 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:43.619512 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1366c827-c7c1-4482-8bdf-0ca752f87958 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:43.869263 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1366c827-c7c1-4482-8bdf-0ca752f87958 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:43.877380 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1366c827-c7c1-4482-8bdf-0ca752f87958 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:43.878955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1366c827-c7c1-4482-8bdf-0ca752f87958 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:43.880142 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1366c827-c7c1-4482-8bdf-0ca752f87958 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1738 microversion: 2.20 time: 0.274585 May 17 12:15:43.881287 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 455/896] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:43 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:44.899568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-52b87ca5-1e7e-4f1b-b823-54c375b979f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:44.901096 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-52b87ca5-1e7e-4f1b-b823-54c375b979f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:44.909472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-52b87ca5-1e7e-4f1b-b823-54c375b979f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:44.910288 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-52b87ca5-1e7e-4f1b-b823-54c375b979f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:44.911470 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-52b87ca5-1e7e-4f1b-b823-54c375b979f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:44.912360 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-52b87ca5-1e7e-4f1b-b823-54c375b979f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:45.090597 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-52b87ca5-1e7e-4f1b-b823-54c375b979f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:45.109460 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-52b87ca5-1e7e-4f1b-b823-54c375b979f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:45.113110 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-d9b01eb1-8bc0-43de-a0b4-60b2c563864a req-07f84eb9-1201-4c1e-8ea4-6bcbd8dfc14e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70", "tag": "17a6f924-0238-4beb-a7c9-3059b4bb15f8"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:45.114517 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-52b87ca5-1e7e-4f1b-b823-54c375b979f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:45.116638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-52b87ca5-1e7e-4f1b-b823-54c375b979f9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1738 microversion: 2.20 time: 0.221673 May 17 12:15:45.118458 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 442/897] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:44 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:45.130552 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-d9b01eb1-8bc0-43de-a0b4-60b2c563864a req-07f84eb9-1201-4c1e-8ea4-6bcbd8dfc14e service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:45.131660 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-d9b01eb1-8bc0-43de-a0b4-60b2c563864a req-07f84eb9-1201-4c1e-8ea4-6bcbd8dfc14e service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:45.144629 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-d9b01eb1-8bc0-43de-a0b4-60b2c563864a req-07f84eb9-1201-4c1e-8ea4-6bcbd8dfc14e service nova] Creating event network-changed:17a6f924-0238-4beb-a7c9-3059b4bb15f8 for instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 on hv-cinder-83769 May 17 12:15:45.151164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-d9b01eb1-8bc0-43de-a0b4-60b2c563864a req-07f84eb9-1201-4c1e-8ea4-6bcbd8dfc14e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043787 May 17 12:15:45.152210 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 456/898] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:15:46.140437 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3544c950-ef7b-42ab-8f68-f3249a7f386f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:46.142357 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-3544c950-ef7b-42ab-8f68-f3249a7f386f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:46.151309 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3544c950-ef7b-42ab-8f68-f3249a7f386f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:46.151950 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3544c950-ef7b-42ab-8f68-f3249a7f386f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:46.152965 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3544c950-ef7b-42ab-8f68-f3249a7f386f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:46.153598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3544c950-ef7b-42ab-8f68-f3249a7f386f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:46.369248 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3544c950-ef7b-42ab-8f68-f3249a7f386f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:46.379219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3544c950-ef7b-42ab-8f68-f3249a7f386f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:46.380815 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3544c950-ef7b-42ab-8f68-f3249a7f386f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:46.389551 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-3544c950-ef7b-42ab-8f68-f3249a7f386f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1738 microversion: 2.20 time: 0.257977 May 17 12:15:46.390170 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 443/899] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:46 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:46.611291 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-404eae22-78aa-4ab3-a8d7-41541662a4e2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1445039270"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:46.612013 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-404eae22-78aa-4ab3-a8d7-41541662a4e2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:46.618928 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-404eae22-78aa-4ab3-a8d7-41541662a4e2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:46.619386 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-404eae22-78aa-4ab3-a8d7-41541662a4e2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:46.620173 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-404eae22-78aa-4ab3-a8d7-41541662a4e2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:46.620804 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-404eae22-78aa-4ab3-a8d7-41541662a4e2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:46.780359 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.network.security_group_api [None req-404eae22-78aa-4ab3-a8d7-41541662a4e2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Adding security group 46ab5eb0-183a-4086-9c79-d63470e071c5 to port 17a6f924-0238-4beb-a7c9-3059b4bb15f8 May 17 12:15:47.237671 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-404eae22-78aa-4ab3-a8d7-41541662a4e2 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "POST /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/action" status: 202 len: 0 microversion: 2.1 time: 0.631126 May 17 12:15:47.239432 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 457/900] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:15:46 2022] POST /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:15:47.249062 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-99d77a19-cb9e-4ed3-9260-56108c809db0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:47.253708 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-99d77a19-cb9e-4ed3-9260-56108c809db0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:47.254494 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-e0486b77-960c-4dc4-9fc2-f79fda5d80ac req-0f715c42-2b10-4570-8ae6-b3f4c8adfdad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70", "tag": "17a6f924-0238-4beb-a7c9-3059b4bb15f8"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:47.268071 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99d77a19-cb9e-4ed3-9260-56108c809db0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:47.269008 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99d77a19-cb9e-4ed3-9260-56108c809db0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:47.269381 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99d77a19-cb9e-4ed3-9260-56108c809db0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:47.269823 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99d77a19-cb9e-4ed3-9260-56108c809db0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:47.273566 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-e0486b77-960c-4dc4-9fc2-f79fda5d80ac req-0f715c42-2b10-4570-8ae6-b3f4c8adfdad service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:47.274299 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-e0486b77-960c-4dc4-9fc2-f79fda5d80ac req-0f715c42-2b10-4570-8ae6-b3f4c8adfdad service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:47.299200 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-e0486b77-960c-4dc4-9fc2-f79fda5d80ac req-0f715c42-2b10-4570-8ae6-b3f4c8adfdad service nova] Creating event network-changed:17a6f924-0238-4beb-a7c9-3059b4bb15f8 for instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 on hv-cinder-83769 May 17 12:15:47.312738 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-e0486b77-960c-4dc4-9fc2-f79fda5d80ac req-0f715c42-2b10-4570-8ae6-b3f4c8adfdad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061728 May 17 12:15:47.317339 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 458/901] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:15:47.407545 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bcfe66fe-f768-4484-ac7c-322b8531ac8e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:47.408711 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bcfe66fe-f768-4484-ac7c-322b8531ac8e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:47.420819 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bcfe66fe-f768-4484-ac7c-322b8531ac8e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:47.424160 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bcfe66fe-f768-4484-ac7c-322b8531ac8e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:47.425265 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bcfe66fe-f768-4484-ac7c-322b8531ac8e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:47.426164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bcfe66fe-f768-4484-ac7c-322b8531ac8e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:47.523401 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-99d77a19-cb9e-4ed3-9260-56108c809db0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:47.536097 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-99d77a19-cb9e-4ed3-9260-56108c809db0 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1760 microversion: 2.1 time: 0.290666 May 17 12:15:47.544223 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 444/902] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:15:47 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1760 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:15:47.710416 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bcfe66fe-f768-4484-ac7c-322b8531ac8e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:47.719159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bcfe66fe-f768-4484-ac7c-322b8531ac8e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:47.721681 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bcfe66fe-f768-4484-ac7c-322b8531ac8e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:47.722862 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bcfe66fe-f768-4484-ac7c-322b8531ac8e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1738 microversion: 2.20 time: 0.319554 May 17 12:15:47.723586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 459/903] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:47 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:15:48.743411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5f158132-6a60-4be6-b35b-df2e66c5bb1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:48.744768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5f158132-6a60-4be6-b35b-df2e66c5bb1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:48.751890 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5f158132-6a60-4be6-b35b-df2e66c5bb1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:48.752371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5f158132-6a60-4be6-b35b-df2e66c5bb1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:48.753152 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5f158132-6a60-4be6-b35b-df2e66c5bb1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:48.753587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5f158132-6a60-4be6-b35b-df2e66c5bb1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:48.894171 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5f158132-6a60-4be6-b35b-df2e66c5bb1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:48.902692 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5f158132-6a60-4be6-b35b-df2e66c5bb1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:48.904457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5f158132-6a60-4be6-b35b-df2e66c5bb1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:48.905960 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5f158132-6a60-4be6-b35b-df2e66c5bb1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1738 microversion: 2.20 time: 0.168245 May 17 12:15:48.907001 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 445/904] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:48 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:49.924873 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a33ab51a-a758-4eb1-bce3-6034a8c139e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:49.926198 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a33ab51a-a758-4eb1-bce3-6034a8c139e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:49.933969 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a33ab51a-a758-4eb1-bce3-6034a8c139e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:49.934500 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a33ab51a-a758-4eb1-bce3-6034a8c139e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:49.935530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a33ab51a-a758-4eb1-bce3-6034a8c139e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:49.936199 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a33ab51a-a758-4eb1-bce3-6034a8c139e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:50.083878 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a33ab51a-a758-4eb1-bce3-6034a8c139e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:50.093079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a33ab51a-a758-4eb1-bce3-6034a8c139e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:50.094843 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a33ab51a-a758-4eb1-bce3-6034a8c139e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:50.096346 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a33ab51a-a758-4eb1-bce3-6034a8c139e7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1738 microversion: 2.20 time: 0.175387 May 17 12:15:50.099142 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 460/905] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:49 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:51.124290 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f503daac-ac0d-4368-811e-0cc94a551a8d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:51.125685 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f503daac-ac0d-4368-811e-0cc94a551a8d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:51.131959 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f503daac-ac0d-4368-811e-0cc94a551a8d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:51.132502 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f503daac-ac0d-4368-811e-0cc94a551a8d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:51.133275 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f503daac-ac0d-4368-811e-0cc94a551a8d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:51.133707 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f503daac-ac0d-4368-811e-0cc94a551a8d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:51.271614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f503daac-ac0d-4368-811e-0cc94a551a8d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:51.280526 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f503daac-ac0d-4368-811e-0cc94a551a8d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:51.282043 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f503daac-ac0d-4368-811e-0cc94a551a8d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:51.283343 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f503daac-ac0d-4368-811e-0cc94a551a8d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1738 microversion: 2.20 time: 0.170491 May 17 12:15:51.283950 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 446/906] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:51 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:15:52.301469 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-573d7331-4b0d-43ca-8aa8-ba6c30b7ceb7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:52.302084 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-573d7331-4b0d-43ca-8aa8-ba6c30b7ceb7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:52.308736 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-573d7331-4b0d-43ca-8aa8-ba6c30b7ceb7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:52.309188 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-573d7331-4b0d-43ca-8aa8-ba6c30b7ceb7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:52.310009 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-573d7331-4b0d-43ca-8aa8-ba6c30b7ceb7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:52.310446 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-573d7331-4b0d-43ca-8aa8-ba6c30b7ceb7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:52.441888 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-573d7331-4b0d-43ca-8aa8-ba6c30b7ceb7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:52.450486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-573d7331-4b0d-43ca-8aa8-ba6c30b7ceb7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:52.451987 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-573d7331-4b0d-43ca-8aa8-ba6c30b7ceb7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:52.453184 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-573d7331-4b0d-43ca-8aa8-ba6c30b7ceb7 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1738 microversion: 2.20 time: 0.155583 May 17 12:15:52.453758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 461/907] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:52 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:53.470887 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-bc58af3e-10b3-487f-b502-86b826222307 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:53.471472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-bc58af3e-10b3-487f-b502-86b826222307 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:53.479020 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc58af3e-10b3-487f-b502-86b826222307 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:53.479477 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc58af3e-10b3-487f-b502-86b826222307 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:53.480272 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc58af3e-10b3-487f-b502-86b826222307 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:53.480707 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc58af3e-10b3-487f-b502-86b826222307 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:53.606878 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-bc58af3e-10b3-487f-b502-86b826222307 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:53.614492 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-bc58af3e-10b3-487f-b502-86b826222307 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:53.616822 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-bc58af3e-10b3-487f-b502-86b826222307 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:53.617976 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-bc58af3e-10b3-487f-b502-86b826222307 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1720 microversion: 2.20 time: 0.151062 May 17 12:15:53.618553 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 447/908] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:53 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:54.636254 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bfe60ab9-de36-46b0-91b5-99a999bebe6f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:54.636802 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bfe60ab9-de36-46b0-91b5-99a999bebe6f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:54.643312 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bfe60ab9-de36-46b0-91b5-99a999bebe6f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:54.643759 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bfe60ab9-de36-46b0-91b5-99a999bebe6f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:54.644578 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bfe60ab9-de36-46b0-91b5-99a999bebe6f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:54.645015 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bfe60ab9-de36-46b0-91b5-99a999bebe6f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:54.772066 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bfe60ab9-de36-46b0-91b5-99a999bebe6f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:54.784393 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bfe60ab9-de36-46b0-91b5-99a999bebe6f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:54.785934 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bfe60ab9-de36-46b0-91b5-99a999bebe6f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:54.787087 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bfe60ab9-de36-46b0-91b5-99a999bebe6f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1720 microversion: 2.20 time: 0.154803 May 17 12:15:54.787657 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 462/909] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:54 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:55.805942 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d1883a8e-e543-4d32-a5a5-b46de4201b34 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:55.806621 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d1883a8e-e543-4d32-a5a5-b46de4201b34 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:55.812988 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1883a8e-e543-4d32-a5a5-b46de4201b34 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:55.813442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1883a8e-e543-4d32-a5a5-b46de4201b34 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:55.814225 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1883a8e-e543-4d32-a5a5-b46de4201b34 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:55.814664 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1883a8e-e543-4d32-a5a5-b46de4201b34 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:55.946319 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d1883a8e-e543-4d32-a5a5-b46de4201b34 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:55.954500 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d1883a8e-e543-4d32-a5a5-b46de4201b34 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:55.956003 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d1883a8e-e543-4d32-a5a5-b46de4201b34 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:55.957193 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d1883a8e-e543-4d32-a5a5-b46de4201b34 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1723 microversion: 2.20 time: 0.155989 May 17 12:15:55.957838 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 448/910] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:55 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:55.974547 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b4d0519a-40b7-4d94-9435-dabe088bd4ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63b364a6-9d19-4673-bdb6-75003bbafa5d"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:55.976160 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b4d0519a-40b7-4d94-9435-dabe088bd4ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:55.982742 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b4d0519a-40b7-4d94-9435-dabe088bd4ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:55.983199 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b4d0519a-40b7-4d94-9435-dabe088bd4ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:55.983979 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b4d0519a-40b7-4d94-9435-dabe088bd4ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:55.984446 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b4d0519a-40b7-4d94-9435-dabe088bd4ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:56.257316 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b4d0519a-40b7-4d94-9435-dabe088bd4ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "POST /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.285976 May 17 12:15:56.257924 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 463/911] 10.222.0.58 () {62 vars in 1363 bytes} [Tue May 17 12:15:55 2022] POST /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 12:15:56.367726 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-084129f5-2408-4b4b-9eae-8f82c4eb2e50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:56.368294 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-084129f5-2408-4b4b-9eae-8f82c4eb2e50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:56.374156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-084129f5-2408-4b4b-9eae-8f82c4eb2e50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:56.374609 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-084129f5-2408-4b4b-9eae-8f82c4eb2e50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:56.375386 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-084129f5-2408-4b4b-9eae-8f82c4eb2e50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:56.375830 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-084129f5-2408-4b4b-9eae-8f82c4eb2e50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:56.599913 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-084129f5-2408-4b4b-9eae-8f82c4eb2e50 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/os-volume_attachments/63b364a6-9d19-4673-bdb6-75003bbafa5d" status: 202 len: 0 microversion: 2.20 time: 0.236418 May 17 12:15:56.600733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 449/912] 10.222.0.58 () {60 vars in 1456 bytes} [Tue May 17 12:15:56 2022] DELETE /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/os-volume_attachments/63b364a6-9d19-4673-bdb6-75003bbafa5d => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 12:15:56.655911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9cb38599-b671-49db-9d4c-2945e6f8e9cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:56.656540 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9cb38599-b671-49db-9d4c-2945e6f8e9cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:56.663290 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9cb38599-b671-49db-9d4c-2945e6f8e9cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:56.663734 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9cb38599-b671-49db-9d4c-2945e6f8e9cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:56.664530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9cb38599-b671-49db-9d4c-2945e6f8e9cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:56.664967 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9cb38599-b671-49db-9d4c-2945e6f8e9cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:56.723408 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-e6f081b4-22af-4e91-a837-06bfeec86c32 req-02f5394e-dd0e-4642-b5bf-13f5380c4f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23", "name": "network-vif-unplugged", "status": "completed", "tag": "3370c5ba-e7d7-4dab-8520-7a3da90d8b4a"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:15:56.735673 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-e6f081b4-22af-4e91-a837-06bfeec86c32 req-02f5394e-dd0e-4642-b5bf-13f5380c4f32 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:56.736361 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-e6f081b4-22af-4e91-a837-06bfeec86c32 req-02f5394e-dd0e-4642-b5bf-13f5380c4f32 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:56.750019 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.compute.server_external_events [req-e6f081b4-22af-4e91-a837-06bfeec86c32 req-02f5394e-dd0e-4642-b5bf-13f5380c4f32 service nova] Unable to find a host for instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23. Dropping event network-vif-unplugged {{(pid=117113) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 12:15:56.750993 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-e6f081b4-22af-4e91-a837-06bfeec86c32 req-02f5394e-dd0e-4642-b5bf-13f5380c4f32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031965 May 17 12:15:56.751738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 450/913] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 17 12:15:56.807809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9cb38599-b671-49db-9d4c-2945e6f8e9cd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "POST /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/action" status: 202 len: 0 microversion: 2.20 time: 0.155029 May 17 12:15:56.811838 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 464/914] 10.222.0.58 () {62 vars in 1318 bytes} [Tue May 17 12:15:56 2022] POST /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 12:15:56.825324 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2247301f-76f6-4b27-9ae0-80490ab27a16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:56.825885 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2247301f-76f6-4b27-9ae0-80490ab27a16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:56.833222 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2247301f-76f6-4b27-9ae0-80490ab27a16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:56.833681 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2247301f-76f6-4b27-9ae0-80490ab27a16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:56.835183 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2247301f-76f6-4b27-9ae0-80490ab27a16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:56.835183 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2247301f-76f6-4b27-9ae0-80490ab27a16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:56.971272 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2247301f-76f6-4b27-9ae0-80490ab27a16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:56.980091 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2247301f-76f6-4b27-9ae0-80490ab27a16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:56.981623 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2247301f-76f6-4b27-9ae0-80490ab27a16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:56.982789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2247301f-76f6-4b27-9ae0-80490ab27a16 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1671 microversion: 2.20 time: 0.169514 May 17 12:15:56.983362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 451/915] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:56 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:58.002515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d1eaf7d3-e34c-40d0-8c4d-83af523117a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:58.003130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d1eaf7d3-e34c-40d0-8c4d-83af523117a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:58.009725 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d1eaf7d3-e34c-40d0-8c4d-83af523117a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:58.010179 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d1eaf7d3-e34c-40d0-8c4d-83af523117a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:58.010976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d1eaf7d3-e34c-40d0-8c4d-83af523117a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:58.011425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d1eaf7d3-e34c-40d0-8c4d-83af523117a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:58.182732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d1eaf7d3-e34c-40d0-8c4d-83af523117a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:58.190556 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d1eaf7d3-e34c-40d0-8c4d-83af523117a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:58.192056 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d1eaf7d3-e34c-40d0-8c4d-83af523117a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:58.193247 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d1eaf7d3-e34c-40d0-8c4d-83af523117a8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.195182 May 17 12:15:58.193916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 465/916] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:57 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:15:59.213107 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-acc76182-690e-4c77-9ad2-80da8fd224db tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:15:59.213728 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-acc76182-690e-4c77-9ad2-80da8fd224db tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:15:59.220271 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-acc76182-690e-4c77-9ad2-80da8fd224db tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:59.220951 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-acc76182-690e-4c77-9ad2-80da8fd224db tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:59.221733 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-acc76182-690e-4c77-9ad2-80da8fd224db tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:15:59.222175 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-acc76182-690e-4c77-9ad2-80da8fd224db tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:15:59.358164 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-acc76182-690e-4c77-9ad2-80da8fd224db tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:59.367692 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-acc76182-690e-4c77-9ad2-80da8fd224db tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:59.369388 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-acc76182-690e-4c77-9ad2-80da8fd224db tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:15:59.370593 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-acc76182-690e-4c77-9ad2-80da8fd224db tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.162183 May 17 12:15:59.375598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 452/917] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:15:59 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:00.388563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5555f14a-189d-4ce9-8b70-44a7a76f0766 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:00.389244 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5555f14a-189d-4ce9-8b70-44a7a76f0766 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:00.395509 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5555f14a-189d-4ce9-8b70-44a7a76f0766 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:00.395959 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5555f14a-189d-4ce9-8b70-44a7a76f0766 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:00.396749 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5555f14a-189d-4ce9-8b70-44a7a76f0766 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:00.397188 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5555f14a-189d-4ce9-8b70-44a7a76f0766 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:00.532360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5555f14a-189d-4ce9-8b70-44a7a76f0766 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:00.543566 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5555f14a-189d-4ce9-8b70-44a7a76f0766 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:00.545096 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5555f14a-189d-4ce9-8b70-44a7a76f0766 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:00.546295 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5555f14a-189d-4ce9-8b70-44a7a76f0766 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.161771 May 17 12:16:00.546853 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 466/918] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:00 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:01.564620 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3784b2f3-529f-426b-94fe-de528845ef53 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:01.565430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-3784b2f3-529f-426b-94fe-de528845ef53 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:01.572375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3784b2f3-529f-426b-94fe-de528845ef53 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:01.573262 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3784b2f3-529f-426b-94fe-de528845ef53 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:01.574051 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3784b2f3-529f-426b-94fe-de528845ef53 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:01.574486 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3784b2f3-529f-426b-94fe-de528845ef53 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:01.707848 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3784b2f3-529f-426b-94fe-de528845ef53 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:01.717275 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3784b2f3-529f-426b-94fe-de528845ef53 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:01.718796 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3784b2f3-529f-426b-94fe-de528845ef53 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:01.719941 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-3784b2f3-529f-426b-94fe-de528845ef53 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.159637 May 17 12:16:01.720821 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 453/919] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:01 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:02.740884 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d27a3c55-732c-41db-af19-82d579311c19 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:02.742266 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d27a3c55-732c-41db-af19-82d579311c19 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:02.750274 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d27a3c55-732c-41db-af19-82d579311c19 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:02.750864 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d27a3c55-732c-41db-af19-82d579311c19 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:02.751800 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d27a3c55-732c-41db-af19-82d579311c19 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:02.752339 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d27a3c55-732c-41db-af19-82d579311c19 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:02.888164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d27a3c55-732c-41db-af19-82d579311c19 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:02.895829 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d27a3c55-732c-41db-af19-82d579311c19 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:02.897535 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d27a3c55-732c-41db-af19-82d579311c19 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:02.898513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d27a3c55-732c-41db-af19-82d579311c19 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.162100 May 17 12:16:02.899274 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 467/920] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:02 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:03.916100 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-da080c4e-29c3-444b-a94e-379e5489a3af tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:03.917886 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-da080c4e-29c3-444b-a94e-379e5489a3af tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:03.924825 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-da080c4e-29c3-444b-a94e-379e5489a3af tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:03.925370 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-da080c4e-29c3-444b-a94e-379e5489a3af tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:03.926222 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-da080c4e-29c3-444b-a94e-379e5489a3af tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:03.926749 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-da080c4e-29c3-444b-a94e-379e5489a3af tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:04.061251 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-da080c4e-29c3-444b-a94e-379e5489a3af tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:04.069210 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-da080c4e-29c3-444b-a94e-379e5489a3af tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:04.070916 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-da080c4e-29c3-444b-a94e-379e5489a3af tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:04.072325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-da080c4e-29c3-444b-a94e-379e5489a3af tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.159898 May 17 12:16:04.073608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 454/921] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:03 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:05.091269 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-daa387f7-440f-406a-b154-3ab9fbc466b6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:05.092013 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-daa387f7-440f-406a-b154-3ab9fbc466b6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:05.100717 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-daa387f7-440f-406a-b154-3ab9fbc466b6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:05.101173 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-daa387f7-440f-406a-b154-3ab9fbc466b6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:05.101989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-daa387f7-440f-406a-b154-3ab9fbc466b6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:05.102505 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-daa387f7-440f-406a-b154-3ab9fbc466b6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:05.238736 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-daa387f7-440f-406a-b154-3ab9fbc466b6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:05.246612 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-daa387f7-440f-406a-b154-3ab9fbc466b6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:05.248105 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-daa387f7-440f-406a-b154-3ab9fbc466b6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:05.249314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-daa387f7-440f-406a-b154-3ab9fbc466b6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.161961 May 17 12:16:05.249877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 468/922] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:05 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:06.267966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d82dd8f2-5c2f-4611-83df-d16ae4e14cee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:06.268927 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d82dd8f2-5c2f-4611-83df-d16ae4e14cee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:06.275297 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d82dd8f2-5c2f-4611-83df-d16ae4e14cee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:06.275751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d82dd8f2-5c2f-4611-83df-d16ae4e14cee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:06.276555 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d82dd8f2-5c2f-4611-83df-d16ae4e14cee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:06.276999 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d82dd8f2-5c2f-4611-83df-d16ae4e14cee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:06.410748 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d82dd8f2-5c2f-4611-83df-d16ae4e14cee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:06.418754 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d82dd8f2-5c2f-4611-83df-d16ae4e14cee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:06.420286 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d82dd8f2-5c2f-4611-83df-d16ae4e14cee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:06.421768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d82dd8f2-5c2f-4611-83df-d16ae4e14cee tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.158388 May 17 12:16:06.422341 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 455/923] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:06 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:07.439893 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-77864339-ce38-4168-aa76-f9074775aeca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:07.440557 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-77864339-ce38-4168-aa76-f9074775aeca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:07.446854 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-77864339-ce38-4168-aa76-f9074775aeca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:07.447303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-77864339-ce38-4168-aa76-f9074775aeca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:07.448088 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-77864339-ce38-4168-aa76-f9074775aeca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:07.448560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-77864339-ce38-4168-aa76-f9074775aeca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:07.597323 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-77864339-ce38-4168-aa76-f9074775aeca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:07.605493 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-77864339-ce38-4168-aa76-f9074775aeca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:07.606999 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-77864339-ce38-4168-aa76-f9074775aeca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:07.608208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-77864339-ce38-4168-aa76-f9074775aeca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.173090 May 17 12:16:07.609505 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 469/924] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:07 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:08.627262 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-13020589-fca1-4bf9-a48d-60e3b3c81281 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:08.627921 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-13020589-fca1-4bf9-a48d-60e3b3c81281 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:08.634348 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-13020589-fca1-4bf9-a48d-60e3b3c81281 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:08.634800 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-13020589-fca1-4bf9-a48d-60e3b3c81281 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:08.635579 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-13020589-fca1-4bf9-a48d-60e3b3c81281 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:08.636019 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-13020589-fca1-4bf9-a48d-60e3b3c81281 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:08.770154 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-13020589-fca1-4bf9-a48d-60e3b3c81281 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:08.778452 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-13020589-fca1-4bf9-a48d-60e3b3c81281 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:08.779889 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-13020589-fca1-4bf9-a48d-60e3b3c81281 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:08.781104 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-13020589-fca1-4bf9-a48d-60e3b3c81281 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.158128 May 17 12:16:08.783316 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 456/925] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:08 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:09.799917 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-318c0d34-f7ee-49ae-9819-169aa685e980 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:09.800541 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-318c0d34-f7ee-49ae-9819-169aa685e980 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:09.806824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-318c0d34-f7ee-49ae-9819-169aa685e980 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:09.807273 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-318c0d34-f7ee-49ae-9819-169aa685e980 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:09.808047 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-318c0d34-f7ee-49ae-9819-169aa685e980 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:09.808514 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-318c0d34-f7ee-49ae-9819-169aa685e980 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:09.836362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-98d365d8-6f18-4553-8f10-3fad3b7ad2a0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:09.836948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-98d365d8-6f18-4553-8f10-3fad3b7ad2a0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:09.844159 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98d365d8-6f18-4553-8f10-3fad3b7ad2a0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:09.844723 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98d365d8-6f18-4553-8f10-3fad3b7ad2a0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:09.845654 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98d365d8-6f18-4553-8f10-3fad3b7ad2a0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:09.847615 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98d365d8-6f18-4553-8f10-3fad3b7ad2a0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:09.874559 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-98d365d8-6f18-4553-8f10-3fad3b7ad2a0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/ips" status: 200 len: 144 microversion: 2.1 time: 0.041916 May 17 12:16:09.875325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 457/926] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 17 12:16:09 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:16:09.963791 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-318c0d34-f7ee-49ae-9819-169aa685e980 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:09.974928 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-318c0d34-f7ee-49ae-9819-169aa685e980 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:09.976446 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-318c0d34-f7ee-49ae-9819-169aa685e980 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:09.977661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-318c0d34-f7ee-49ae-9819-169aa685e980 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.182395 May 17 12:16:09.978391 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 470/927] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:09 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:10.996364 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c41f953f-322e-4927-b5cf-28f3433941ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:10.996980 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c41f953f-322e-4927-b5cf-28f3433941ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:11.003740 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c41f953f-322e-4927-b5cf-28f3433941ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:11.004214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c41f953f-322e-4927-b5cf-28f3433941ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:11.004977 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c41f953f-322e-4927-b5cf-28f3433941ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:11.005413 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c41f953f-322e-4927-b5cf-28f3433941ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:11.133189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c41f953f-322e-4927-b5cf-28f3433941ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:11.140851 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c41f953f-322e-4927-b5cf-28f3433941ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:11.142343 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c41f953f-322e-4927-b5cf-28f3433941ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:11.144202 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c41f953f-322e-4927-b5cf-28f3433941ab tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.151815 May 17 12:16:11.144785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 458/928] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:10 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:12.162406 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e42e3964-b52a-40b0-9248-2d48523fed76 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:12.163007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e42e3964-b52a-40b0-9248-2d48523fed76 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:12.169626 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e42e3964-b52a-40b0-9248-2d48523fed76 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:12.170062 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e42e3964-b52a-40b0-9248-2d48523fed76 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:12.170832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e42e3964-b52a-40b0-9248-2d48523fed76 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:12.171266 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e42e3964-b52a-40b0-9248-2d48523fed76 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:12.258034 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5a0d1f14-1832-4f34-be2d-e8f806eec141 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5909d347-3896-4d1c-8cc8-41ce6ecf5cc8"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:16:12.259122 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5a0d1f14-1832-4f34-be2d-e8f806eec141 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:12.265464 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a0d1f14-1832-4f34-be2d-e8f806eec141 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:12.265919 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a0d1f14-1832-4f34-be2d-e8f806eec141 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:12.266694 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a0d1f14-1832-4f34-be2d-e8f806eec141 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:12.267136 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5a0d1f14-1832-4f34-be2d-e8f806eec141 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:12.298046 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e42e3964-b52a-40b0-9248-2d48523fed76 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:12.306223 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e42e3964-b52a-40b0-9248-2d48523fed76 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:12.307815 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e42e3964-b52a-40b0-9248-2d48523fed76 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:12.309094 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e42e3964-b52a-40b0-9248-2d48523fed76 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.151309 May 17 12:16:12.309734 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 471/929] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:12 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:13.327313 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6b19e7ae-520b-43ff-81c0-77142110963e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:13.328009 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6b19e7ae-520b-43ff-81c0-77142110963e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:13.334420 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b19e7ae-520b-43ff-81c0-77142110963e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:13.334863 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b19e7ae-520b-43ff-81c0-77142110963e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:13.335620 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b19e7ae-520b-43ff-81c0-77142110963e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:13.336052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6b19e7ae-520b-43ff-81c0-77142110963e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:13.463416 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6b19e7ae-520b-43ff-81c0-77142110963e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:13.471258 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6b19e7ae-520b-43ff-81c0-77142110963e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:13.472861 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6b19e7ae-520b-43ff-81c0-77142110963e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:13.474001 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6b19e7ae-520b-43ff-81c0-77142110963e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.150973 May 17 12:16:13.474565 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 472/930] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:13 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:16:14.491750 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-51c7f7da-40d7-4db0-b91a-0f029c48e34c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:14.492452 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-51c7f7da-40d7-4db0-b91a-0f029c48e34c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:14.498700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-51c7f7da-40d7-4db0-b91a-0f029c48e34c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:14.499144 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-51c7f7da-40d7-4db0-b91a-0f029c48e34c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:14.499900 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-51c7f7da-40d7-4db0-b91a-0f029c48e34c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:14.500377 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-51c7f7da-40d7-4db0-b91a-0f029c48e34c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:14.625803 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-51c7f7da-40d7-4db0-b91a-0f029c48e34c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:14.633458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-51c7f7da-40d7-4db0-b91a-0f029c48e34c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:14.634945 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-51c7f7da-40d7-4db0-b91a-0f029c48e34c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:14.636083 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-51c7f7da-40d7-4db0-b91a-0f029c48e34c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.148176 May 17 12:16:14.636676 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 473/931] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:14 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:16:15.654971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0f14ed34-7134-4884-8c40-78452e7050d0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:15.655599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0f14ed34-7134-4884-8c40-78452e7050d0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:15.662595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0f14ed34-7134-4884-8c40-78452e7050d0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:15.663045 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0f14ed34-7134-4884-8c40-78452e7050d0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:15.663813 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0f14ed34-7134-4884-8c40-78452e7050d0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:15.664295 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0f14ed34-7134-4884-8c40-78452e7050d0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:15.794374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0f14ed34-7134-4884-8c40-78452e7050d0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:15.802737 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0f14ed34-7134-4884-8c40-78452e7050d0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:15.804270 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0f14ed34-7134-4884-8c40-78452e7050d0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:15.805427 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0f14ed34-7134-4884-8c40-78452e7050d0 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.154739 May 17 12:16:15.806029 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 474/932] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:15 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:16:16.643313 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5a0d1f14-1832-4f34-be2d-e8f806eec141 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.388583 May 17 12:16:16.644335 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 459/933] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:16:12 2022] POST /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments => generated 194 bytes in 4391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:16:16.823501 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a1e30b2b-3b4e-4052-80b5-276f745496e8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:16.824394 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a1e30b2b-3b4e-4052-80b5-276f745496e8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:16.833484 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a1e30b2b-3b4e-4052-80b5-276f745496e8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:16.833939 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a1e30b2b-3b4e-4052-80b5-276f745496e8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:16.834743 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a1e30b2b-3b4e-4052-80b5-276f745496e8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:16.835377 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a1e30b2b-3b4e-4052-80b5-276f745496e8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:16.970865 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a1e30b2b-3b4e-4052-80b5-276f745496e8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:16.979020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a1e30b2b-3b4e-4052-80b5-276f745496e8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:16.980727 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a1e30b2b-3b4e-4052-80b5-276f745496e8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:16.981954 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a1e30b2b-3b4e-4052-80b5-276f745496e8 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.162955 May 17 12:16:16.982513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 475/934] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:16 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:18.000030 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9d475360-a9a3-4414-af25-d86dcc3a0cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:18.000777 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9d475360-a9a3-4414-af25-d86dcc3a0cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:18.007224 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9d475360-a9a3-4414-af25-d86dcc3a0cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:18.007675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9d475360-a9a3-4414-af25-d86dcc3a0cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:18.008472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9d475360-a9a3-4414-af25-d86dcc3a0cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:18.008916 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9d475360-a9a3-4414-af25-d86dcc3a0cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:18.189774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-9d475360-a9a3-4414-af25-d86dcc3a0cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:18.197381 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-9d475360-a9a3-4414-af25-d86dcc3a0cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:18.198871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-9d475360-a9a3-4414-af25-d86dcc3a0cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:18.200312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-9d475360-a9a3-4414-af25-d86dcc3a0cca tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.204770 May 17 12:16:18.200878 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 460/935] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:17 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:18.790047 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-4cca4a82-960e-4273-9e0b-852d38784f30 req-1edbecd7-9f2e-4379-8e80-0a0b5d5e0860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23", "name": "network-vif-plugged", "status": "completed", "tag": "3370c5ba-e7d7-4dab-8520-7a3da90d8b4a"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:16:18.800019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-4cca4a82-960e-4273-9e0b-852d38784f30 req-1edbecd7-9f2e-4379-8e80-0a0b5d5e0860 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:18.800517 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-4cca4a82-960e-4273-9e0b-852d38784f30 req-1edbecd7-9f2e-4379-8e80-0a0b5d5e0860 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:18.811704 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-4cca4a82-960e-4273-9e0b-852d38784f30 req-1edbecd7-9f2e-4379-8e80-0a0b5d5e0860 service nova] Creating event network-vif-plugged:3370c5ba-e7d7-4dab-8520-7a3da90d8b4a for instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 on hv-cinder-83769 May 17 12:16:18.818496 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-4cca4a82-960e-4273-9e0b-852d38784f30 req-1edbecd7-9f2e-4379-8e80-0a0b5d5e0860 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032032 May 17 12:16:18.819119 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 476/936] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:16:19.218738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5044bdda-ff19-45d4-80a2-fd94f16ab65e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:19.219345 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5044bdda-ff19-45d4-80a2-fd94f16ab65e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:19.226236 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5044bdda-ff19-45d4-80a2-fd94f16ab65e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:19.226681 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5044bdda-ff19-45d4-80a2-fd94f16ab65e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:19.227441 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5044bdda-ff19-45d4-80a2-fd94f16ab65e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:19.227876 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5044bdda-ff19-45d4-80a2-fd94f16ab65e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:19.354119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5044bdda-ff19-45d4-80a2-fd94f16ab65e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:19.362712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5044bdda-ff19-45d4-80a2-fd94f16ab65e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:19.364274 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5044bdda-ff19-45d4-80a2-fd94f16ab65e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:19.365438 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5044bdda-ff19-45d4-80a2-fd94f16ab65e tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.150674 May 17 12:16:19.366017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 461/937] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:19 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:16:20.383819 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e8e628a1-e457-4b12-836d-271d69a1991f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:20.384532 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e8e628a1-e457-4b12-836d-271d69a1991f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:20.391024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8e628a1-e457-4b12-836d-271d69a1991f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:20.391586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8e628a1-e457-4b12-836d-271d69a1991f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:20.392392 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8e628a1-e457-4b12-836d-271d69a1991f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:20.393035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e8e628a1-e457-4b12-836d-271d69a1991f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:20.573542 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e8e628a1-e457-4b12-836d-271d69a1991f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:20.581681 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e8e628a1-e457-4b12-836d-271d69a1991f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:20.583194 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e8e628a1-e457-4b12-836d-271d69a1991f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:20.584401 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e8e628a1-e457-4b12-836d-271d69a1991f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1729 microversion: 2.20 time: 0.204764 May 17 12:16:20.585068 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 477/938] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:20 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:21.602509 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-dcf33990-28d5-4ec6-823b-2a17fe0e2edd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:21.603051 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-dcf33990-28d5-4ec6-823b-2a17fe0e2edd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:21.609577 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dcf33990-28d5-4ec6-823b-2a17fe0e2edd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:21.610029 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dcf33990-28d5-4ec6-823b-2a17fe0e2edd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:21.610798 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dcf33990-28d5-4ec6-823b-2a17fe0e2edd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:21.611285 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-dcf33990-28d5-4ec6-823b-2a17fe0e2edd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:21.738953 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-dcf33990-28d5-4ec6-823b-2a17fe0e2edd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:21.746820 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-dcf33990-28d5-4ec6-823b-2a17fe0e2edd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:21.748366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-dcf33990-28d5-4ec6-823b-2a17fe0e2edd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:21.749530 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-dcf33990-28d5-4ec6-823b-2a17fe0e2edd tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1716 microversion: 2.20 time: 0.151088 May 17 12:16:21.750102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 462/939] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:16:21 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:16:24.116301 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3da9e739-595d-42ce-a7ab-701ebee58e6d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:24.117339 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3da9e739-595d-42ce-a7ab-701ebee58e6d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:24.123608 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3da9e739-595d-42ce-a7ab-701ebee58e6d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:24.124052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3da9e739-595d-42ce-a7ab-701ebee58e6d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:24.124845 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3da9e739-595d-42ce-a7ab-701ebee58e6d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:24.125278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3da9e739-595d-42ce-a7ab-701ebee58e6d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:24.153637 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3da9e739-595d-42ce-a7ab-701ebee58e6d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041229 May 17 12:16:24.154202 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 478/940] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:16:24 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:16:24.164560 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-63a35cd3-4493-45ca-9f9a-b999ba59cbfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:24.165083 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-63a35cd3-4493-45ca-9f9a-b999ba59cbfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:24.171243 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-63a35cd3-4493-45ca-9f9a-b999ba59cbfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:24.171688 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-63a35cd3-4493-45ca-9f9a-b999ba59cbfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:24.172479 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-63a35cd3-4493-45ca-9f9a-b999ba59cbfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:24.172914 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-63a35cd3-4493-45ca-9f9a-b999ba59cbfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:24.199663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-63a35cd3-4493-45ca-9f9a-b999ba59cbfd tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments/5909d347-3896-4d1c-8cc8-41ce6ecf5cc8" status: 200 len: 194 microversion: 2.1 time: 0.039053 May 17 12:16:24.200512 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 463/941] 10.222.0.58 () {58 vars in 1412 bytes} [Tue May 17 12:16:24 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments/5909d347-3896-4d1c-8cc8-41ce6ecf5cc8 => generated 194 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:16:25.503418 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-030c47dd-0233-48a1-a3da-ff31514afd8d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b79b157a-9975-4c41-a8bd-5a83e4bc07c0"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:16:25.504522 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-030c47dd-0233-48a1-a3da-ff31514afd8d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:25.510793 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-030c47dd-0233-48a1-a3da-ff31514afd8d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:25.511247 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-030c47dd-0233-48a1-a3da-ff31514afd8d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:25.512019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-030c47dd-0233-48a1-a3da-ff31514afd8d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:25.512502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-030c47dd-0233-48a1-a3da-ff31514afd8d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:25.755689 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-030c47dd-0233-48a1-a3da-ff31514afd8d tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "POST /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256115 May 17 12:16:25.756474 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 479/942] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:16:25 2022] POST /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:16:33.222241 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-99faa1f1-c84f-400b-94e0-4b13d8675057 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:33.223230 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-99faa1f1-c84f-400b-94e0-4b13d8675057 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:33.230347 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99faa1f1-c84f-400b-94e0-4b13d8675057 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:33.230796 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99faa1f1-c84f-400b-94e0-4b13d8675057 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:33.231560 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99faa1f1-c84f-400b-94e0-4b13d8675057 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:33.231992 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-99faa1f1-c84f-400b-94e0-4b13d8675057 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:33.262913 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-99faa1f1-c84f-400b-94e0-4b13d8675057 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044643 May 17 12:16:33.263477 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 464/943] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:16:33 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:16:33.407075 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f4118c1c-8905-42fc-86a0-f4402b49be72 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:33.407653 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f4118c1c-8905-42fc-86a0-f4402b49be72 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:33.413735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f4118c1c-8905-42fc-86a0-f4402b49be72 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:33.414188 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f4118c1c-8905-42fc-86a0-f4402b49be72 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:33.414957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f4118c1c-8905-42fc-86a0-f4402b49be72 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:33.415398 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f4118c1c-8905-42fc-86a0-f4402b49be72 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:33.444436 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f4118c1c-8905-42fc-86a0-f4402b49be72 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments/5909d347-3896-4d1c-8cc8-41ce6ecf5cc8" status: 200 len: 194 microversion: 2.1 time: 0.042129 May 17 12:16:33.445026 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 480/944] 10.222.0.58 () {58 vars in 1412 bytes} [Tue May 17 12:16:33 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments/5909d347-3896-4d1c-8cc8-41ce6ecf5cc8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:16:33.454826 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-15cc8357-d0c5-4fff-90d2-ece0991aa06f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:33.455356 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-15cc8357-d0c5-4fff-90d2-ece0991aa06f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:33.462453 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-15cc8357-d0c5-4fff-90d2-ece0991aa06f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:33.462908 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-15cc8357-d0c5-4fff-90d2-ece0991aa06f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:33.463689 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-15cc8357-d0c5-4fff-90d2-ece0991aa06f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:33.464131 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-15cc8357-d0c5-4fff-90d2-ece0991aa06f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:33.541398 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-15cc8357-d0c5-4fff-90d2-ece0991aa06f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lazy-loading 'services' on Instance uuid d1173f42-664f-4561-8e8f-0842a8d139cc {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:16:33.609837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-15cc8357-d0c5-4fff-90d2-ece0991aa06f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments/5909d347-3896-4d1c-8cc8-41ce6ecf5cc8" status: 202 len: 0 microversion: 2.1 time: 0.158757 May 17 12:16:33.610443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 465/945] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:16:33 2022] DELETE /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments/5909d347-3896-4d1c-8cc8-41ce6ecf5cc8 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:16:35.770516 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5a087bf4-db35-43e8-a6da-4b57ed6b27c7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:35.771273 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5a087bf4-db35-43e8-a6da-4b57ed6b27c7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:35.777270 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5a087bf4-db35-43e8-a6da-4b57ed6b27c7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:35.777801 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5a087bf4-db35-43e8-a6da-4b57ed6b27c7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:35.778518 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5a087bf4-db35-43e8-a6da-4b57ed6b27c7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:35.778958 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5a087bf4-db35-43e8-a6da-4b57ed6b27c7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:35.807566 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5a087bf4-db35-43e8-a6da-4b57ed6b27c7 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments/b79b157a-9975-4c41-a8bd-5a83e4bc07c0" status: 200 len: 194 microversion: 2.1 time: 0.040951 May 17 12:16:35.808151 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 481/946] 10.222.0.58 () {58 vars in 1412 bytes} [Tue May 17 12:16:35 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments/b79b157a-9975-4c41-a8bd-5a83e4bc07c0 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:16:35.820371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-672cb048-c997-4d38-a894-9e00a60d8675 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:35.820961 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-672cb048-c997-4d38-a894-9e00a60d8675 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:35.827336 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-672cb048-c997-4d38-a894-9e00a60d8675 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:35.827794 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-672cb048-c997-4d38-a894-9e00a60d8675 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:35.828594 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-672cb048-c997-4d38-a894-9e00a60d8675 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:35.829074 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-672cb048-c997-4d38-a894-9e00a60d8675 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:35.905449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-672cb048-c997-4d38-a894-9e00a60d8675 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lazy-loading 'services' on Instance uuid d1173f42-664f-4561-8e8f-0842a8d139cc {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:16:35.973991 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-672cb048-c997-4d38-a894-9e00a60d8675 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments/b79b157a-9975-4c41-a8bd-5a83e4bc07c0" status: 202 len: 0 microversion: 2.1 time: 0.158264 May 17 12:16:35.974635 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 466/947] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:16:35 2022] DELETE /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments/b79b157a-9975-4c41-a8bd-5a83e4bc07c0 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:16:37.126691 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d252a7b9-367d-4e78-b57e-ff5abdfdc4ad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:37.127635 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d252a7b9-367d-4e78-b57e-ff5abdfdc4ad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:37.134793 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d252a7b9-367d-4e78-b57e-ff5abdfdc4ad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:37.135191 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d252a7b9-367d-4e78-b57e-ff5abdfdc4ad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:37.135967 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d252a7b9-367d-4e78-b57e-ff5abdfdc4ad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:37.136441 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d252a7b9-367d-4e78-b57e-ff5abdfdc4ad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:37.164359 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d252a7b9-367d-4e78-b57e-ff5abdfdc4ad tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041675 May 17 12:16:37.164914 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 482/948] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:16:37 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 12:16:37.266974 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5b9d2c99-7dc4-4caa-a73d-b1d9b3cc7c60 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:37.268028 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5b9d2c99-7dc4-4caa-a73d-b1d9b3cc7c60 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:37.274596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b9d2c99-7dc4-4caa-a73d-b1d9b3cc7c60 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:37.275042 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b9d2c99-7dc4-4caa-a73d-b1d9b3cc7c60 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:37.275801 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b9d2c99-7dc4-4caa-a73d-b1d9b3cc7c60 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:37.276261 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5b9d2c99-7dc4-4caa-a73d-b1d9b3cc7c60 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:37.303049 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5b9d2c99-7dc4-4caa-a73d-b1d9b3cc7c60 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040826 May 17 12:16:37.303597 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 467/949] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:16:37 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 12:16:37.359501 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f9f08d60-9b84-4566-a675-8248b4886158 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:37.359991 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f9f08d60-9b84-4566-a675-8248b4886158 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:37.366145 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f9f08d60-9b84-4566-a675-8248b4886158 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:37.366693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f9f08d60-9b84-4566-a675-8248b4886158 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:37.367618 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f9f08d60-9b84-4566-a675-8248b4886158 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:37.368058 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f9f08d60-9b84-4566-a675-8248b4886158 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:37.393671 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f9f08d60-9b84-4566-a675-8248b4886158 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:16:37.466377 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f9f08d60-9b84-4566-a675-8248b4886158 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 204 len: 0 microversion: 2.1 time: 0.110477 May 17 12:16:37.467200 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 483/950] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:16:37 2022] DELETE /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:16:37.475237 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-20d1c733-2897-4cdc-8b9e-d084f61f874b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:37.475847 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-20d1c733-2897-4cdc-8b9e-d084f61f874b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:37.481775 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-20d1c733-2897-4cdc-8b9e-d084f61f874b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:37.482229 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-20d1c733-2897-4cdc-8b9e-d084f61f874b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:37.482996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-20d1c733-2897-4cdc-8b9e-d084f61f874b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:37.483439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-20d1c733-2897-4cdc-8b9e-d084f61f874b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:37.615235 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-20d1c733-2897-4cdc-8b9e-d084f61f874b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:37.622564 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-20d1c733-2897-4cdc-8b9e-d084f61f874b tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1671 microversion: 2.1 time: 0.151104 May 17 12:16:37.623144 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 468/951] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:16:37 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:16:38.641307 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bac4f821-388a-473b-a57b-8a4b5a9dfad9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:38.641923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bac4f821-388a-473b-a57b-8a4b5a9dfad9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:38.648953 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bac4f821-388a-473b-a57b-8a4b5a9dfad9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:38.649514 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bac4f821-388a-473b-a57b-8a4b5a9dfad9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:38.650279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bac4f821-388a-473b-a57b-8a4b5a9dfad9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:38.650718 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bac4f821-388a-473b-a57b-8a4b5a9dfad9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:38.782527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bac4f821-388a-473b-a57b-8a4b5a9dfad9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:38.790260 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bac4f821-388a-473b-a57b-8a4b5a9dfad9 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1671 microversion: 2.1 time: 0.153368 May 17 12:16:38.790838 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 484/952] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:16:38 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:16:39.816201 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1328b6a4-6251-4e66-8627-b2854a6db65f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:39.816849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1328b6a4-6251-4e66-8627-b2854a6db65f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:39.823732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1328b6a4-6251-4e66-8627-b2854a6db65f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:39.825163 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1328b6a4-6251-4e66-8627-b2854a6db65f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:39.825313 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1328b6a4-6251-4e66-8627-b2854a6db65f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:39.825702 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1328b6a4-6251-4e66-8627-b2854a6db65f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:39.954424 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1328b6a4-6251-4e66-8627-b2854a6db65f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:39.962625 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1328b6a4-6251-4e66-8627-b2854a6db65f tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1671 microversion: 2.1 time: 0.159260 May 17 12:16:39.963204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 469/953] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:16:39 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:16:40.874901 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-f5711c77-0165-4b7c-bb67-037265d178a7 req-e36aeab5-3b91-4c41-94bc-25bdab7ea7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1173f42-664f-4561-8e8f-0842a8d139cc", "name": "network-vif-deleted", "tag": "92cac3bc-855a-4b91-acf1-b871ad7271cc"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:16:40.887994 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-f5711c77-0165-4b7c-bb67-037265d178a7 req-e36aeab5-3b91-4c41-94bc-25bdab7ea7c9 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:40.889514 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-f5711c77-0165-4b7c-bb67-037265d178a7 req-e36aeab5-3b91-4c41-94bc-25bdab7ea7c9 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:40.902364 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-f5711c77-0165-4b7c-bb67-037265d178a7 req-e36aeab5-3b91-4c41-94bc-25bdab7ea7c9 service nova] Creating event network-vif-deleted:92cac3bc-855a-4b91-acf1-b871ad7271cc for instance d1173f42-664f-4561-8e8f-0842a8d139cc on hv-cinder-83769 May 17 12:16:40.908164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-f5711c77-0165-4b7c-bb67-037265d178a7 req-e36aeab5-3b91-4c41-94bc-25bdab7ea7c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037166 May 17 12:16:40.909836 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 485/954] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:16:40.983941 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:40.984658 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:40.995829 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:40.996443 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:40.997303 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:40.997973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:41.047416 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:41.047903 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:41.048420 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lazy-loading 'fault' on Instance uuid d1173f42-664f-4561-8e8f-0842a8d139cc {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:16:41.101037 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79ff688720854ad1b62b3c9b51546e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae797920785457f975f9f85d80849af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:16:41.109699 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8789b351-7f94-4441-9136-44f482fd4570 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 200 len: 1327 microversion: 2.1 time: 0.132687 May 17 12:16:41.110642 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 470/955] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:16:40 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:16:42.128539 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-75087e70-ebd2-4668-93b9-3f8b98765b41 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:42.129163 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-75087e70-ebd2-4668-93b9-3f8b98765b41 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:42.136527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-75087e70-ebd2-4668-93b9-3f8b98765b41 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:42.136972 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-75087e70-ebd2-4668-93b9-3f8b98765b41 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:42.137731 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-75087e70-ebd2-4668-93b9-3f8b98765b41 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:42.138165 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-75087e70-ebd2-4668-93b9-3f8b98765b41 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:42.151045 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-75087e70-ebd2-4668-93b9-3f8b98765b41 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] HTTP exception thrown: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-75087e70-ebd2-4668-93b9-3f8b98765b41 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Request method failure captured: May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc HTTP/1.1 May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_Ire0y3NWrIHMMW3XR3Z7e0zp0KTLbY_tfcbTu6RFVpq3lxFmcRph7RFHr0_HQdmVwD3Ce7NlNqzogum-WQMp5XODqISdobMg8nCF5UKXPYjjhlQjvaCFQNomU5xzNwDHNs_wkkcqBVGQEfpitOCOfEv0OEwMg9WHDjYe2H3dSv4M May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 2ae797920785457f975f9f85d80849af May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:16:42.152680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2ae797920785457f975f9f85d80849af", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2ae797920785457f975f9f85d80849af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}] May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 2ae797920785457f975f9f85d80849af May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 79ff688720854ad1b62b3c9b51546e0f May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:42.154325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'd1173f42-664f-4561-8e8f-0842a8d139cc'} May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:16:42.155374 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:42.157042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:42.158507 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-75087e70-ebd2-4668-93b9-3f8b98765b41 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Returning 404 to user: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:16:42.158507 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-75087e70-ebd2-4668-93b9-3f8b98765b41 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 404 len: 111 microversion: 2.1 time: 0.029794 May 17 12:16:42.158507 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 486/956] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:16:42 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:16:42.162711 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e4caa506-816f-4ccf-b6da-221c0c670efb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '.version_select at 0x7f2db4308a60>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:42.180173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e4caa506-816f-4ccf-b6da-221c0c670efb tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-727529117" status: 202 len: 0 microversion: 2.1 time: 0.021171 May 17 12:16:42.180778 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 471/957] 10.222.0.58 () {58 vars in 1217 bytes} [Tue May 17 12:16:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-727529117 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 12:16:45.023808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cba4f11b-4576-4f86-ac71-c34f354cf75a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:45.024337 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cba4f11b-4576-4f86-ac71-c34f354cf75a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:45.030530 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cba4f11b-4576-4f86-ac71-c34f354cf75a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:45.030972 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cba4f11b-4576-4f86-ac71-c34f354cf75a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:45.031726 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cba4f11b-4576-4f86-ac71-c34f354cf75a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:45.032158 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cba4f11b-4576-4f86-ac71-c34f354cf75a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:45.045994 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-cba4f11b-4576-4f86-ac71-c34f354cf75a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] HTTP exception thrown: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cba4f11b-4576-4f86-ac71-c34f354cf75a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Request method failure captured: May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: DELETE /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc HTTP/1.1 May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_Ire0y3NWrIHMMW3XR3Z7e0zp0KTLbY_tfcbTu6RFVpq3lxFmcRph7RFHr0_HQdmVwD3Ce7NlNqzogum-WQMp5XODqISdobMg8nCF5UKXPYjjhlQjvaCFQNomU5xzNwDHNs_wkkcqBVGQEfpitOCOfEv0OEwMg9WHDjYe2H3dSv4M May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 2ae797920785457f975f9f85d80849af May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:16:45.047513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2ae797920785457f975f9f85d80849af", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2ae797920785457f975f9f85d80849af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}] May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 2ae797920785457f975f9f85d80849af May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 79ff688720854ad1b62b3c9b51546e0f May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:45.049082 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'd1173f42-664f-4561-8e8f-0842a8d139cc'} May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:16:45.050052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:45.051579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:45.053249 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cba4f11b-4576-4f86-ac71-c34f354cf75a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Returning 404 to user: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:16:45.053249 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cba4f11b-4576-4f86-ac71-c34f354cf75a tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 404 len: 111 microversion: 2.1 time: 0.029627 May 17 12:16:45.053249 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 487/958] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:16:45 2022] DELETE /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:16:45.058055 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a415bd0f-1dc3-48c7-8a18-676c84f7eeb0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:45.058671 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a415bd0f-1dc3-48c7-8a18-676c84f7eeb0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: d1173f42-664f-4561-8e8f-0842a8d139cc] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:45.066646 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a415bd0f-1dc3-48c7-8a18-676c84f7eeb0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:45.067099 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a415bd0f-1dc3-48c7-8a18-676c84f7eeb0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:45.067989 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a415bd0f-1dc3-48c7-8a18-676c84f7eeb0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:45.068462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a415bd0f-1dc3-48c7-8a18-676c84f7eeb0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:45.081355 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-a415bd0f-1dc3-48c7-8a18-676c84f7eeb0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] HTTP exception thrown: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a415bd0f-1dc3-48c7-8a18-676c84f7eeb0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Request method failure captured: May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc HTTP/1.1 May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_Ire0y3NWrIHMMW3XR3Z7e0zp0KTLbY_tfcbTu6RFVpq3lxFmcRph7RFHr0_HQdmVwD3Ce7NlNqzogum-WQMp5XODqISdobMg8nCF5UKXPYjjhlQjvaCFQNomU5xzNwDHNs_wkkcqBVGQEfpitOCOfEv0OEwMg9WHDjYe2H3dSv4M May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 2ae797920785457f975f9f85d80849af May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:16:45.083462 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2ae797920785457f975f9f85d80849af", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2ae797920785457f975f9f85d80849af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}] May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 2ae797920785457f975f9f85d80849af May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 79ff688720854ad1b62b3c9b51546e0f May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:45.085014 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'd1173f42-664f-4561-8e8f-0842a8d139cc'} May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:16:45.085933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. May 17 12:16:45.087362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:16:45.088759 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a415bd0f-1dc3-48c7-8a18-676c84f7eeb0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Returning 404 to user: Instance d1173f42-664f-4561-8e8f-0842a8d139cc could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:16:45.088759 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a415bd0f-1dc3-48c7-8a18-676c84f7eeb0 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc" status: 404 len: 111 microversion: 2.1 time: 0.031103 May 17 12:16:45.088759 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 472/959] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:16:45 2022] GET /compute/v2.1/servers/d1173f42-664f-4561-8e8f-0842a8d139cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:16:46.218985 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fba2710c-5d51-43cf-b974-b5f38b1ee4a2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:46.219532 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fba2710c-5d51-43cf-b974-b5f38b1ee4a2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:46.226761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fba2710c-5d51-43cf-b974-b5f38b1ee4a2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:46.227209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fba2710c-5d51-43cf-b974-b5f38b1ee4a2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:46.227979 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fba2710c-5d51-43cf-b974-b5f38b1ee4a2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:46.228446 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fba2710c-5d51-43cf-b974-b5f38b1ee4a2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:46.242073 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-fba2710c-5d51-43cf-b974-b5f38b1ee4a2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] HTTP exception thrown: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fba2710c-5d51-43cf-b974-b5f38b1ee4a2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Request method failure captured: May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: DELETE /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 HTTP/1.1 May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_Ire0y3NWrIHMMW3XR3Z7e0zp0KTLbY_tfcbTu6RFVpq3lxFmcRph7RFHr0_HQdmVwD3Ce7NlNqzogum-WQMp5XODqISdobMg8nCF5UKXPYjjhlQjvaCFQNomU5xzNwDHNs_wkkcqBVGQEfpitOCOfEv0OEwMg9WHDjYe2H3dSv4M May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 2ae797920785457f975f9f85d80849af May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:16:46.243600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2ae797920785457f975f9f85d80849af", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2ae797920785457f975f9f85d80849af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}] May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 2ae797920785457f975f9f85d80849af May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 79ff688720854ad1b62b3c9b51546e0f May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:16:46.245190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '7d7d37bf-7c1d-43d6-9ede-a2e330b5a043'} May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:16:46.246175 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:16:46.247700 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:16:46.249354 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fba2710c-5d51-43cf-b974-b5f38b1ee4a2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Returning 404 to user: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:16:46.249354 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fba2710c-5d51-43cf-b974-b5f38b1ee4a2 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 404 len: 111 microversion: 2.1 time: 0.035471 May 17 12:16:46.249354 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 488/960] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:16:46 2022] DELETE /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 12:16:46.253429 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c1f6fcf4-644e-4632-8bdd-0357a219c4c5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:16:46.254046 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c1f6fcf4-644e-4632-8bdd-0357a219c4c5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] [instance: 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:16:46.260524 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c1f6fcf4-644e-4632-8bdd-0357a219c4c5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:46.260972 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c1f6fcf4-644e-4632-8bdd-0357a219c4c5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:46.261727 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c1f6fcf4-644e-4632-8bdd-0357a219c4c5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:16:46.262163 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c1f6fcf4-644e-4632-8bdd-0357a219c4c5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:16:46.275164 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-c1f6fcf4-644e-4632-8bdd-0357a219c4c5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] HTTP exception thrown: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c1f6fcf4-644e-4632-8bdd-0357a219c4c5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Request method failure captured: May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 HTTP/1.1 May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_Ire0y3NWrIHMMW3XR3Z7e0zp0KTLbY_tfcbTu6RFVpq3lxFmcRph7RFHr0_HQdmVwD3Ce7NlNqzogum-WQMp5XODqISdobMg8nCF5UKXPYjjhlQjvaCFQNomU5xzNwDHNs_wkkcqBVGQEfpitOCOfEv0OEwMg9WHDjYe2H3dSv4M May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 2ae797920785457f975f9f85d80849af May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:16:46.276732 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2ae797920785457f975f9f85d80849af", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2ae797920785457f975f9f85d80849af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2ae797920785457f975f9f85d80849af"}]}] May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 2ae797920785457f975f9f85d80849af May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2050431149 May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 79ff688720854ad1b62b3c9b51546e0f May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeTestJSON-2050431149-project May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:16:46.278256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '7d7d37bf-7c1d-43d6-9ede-a2e330b5a043'} May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:16:46.279117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. May 17 12:16:46.280449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:16:46.281774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c1f6fcf4-644e-4632-8bdd-0357a219c4c5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] Returning 404 to user: Instance 7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:16:46.281774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c1f6fcf4-644e-4632-8bdd-0357a219c4c5 tempest-AttachVolumeTestJSON-2050431149 tempest-AttachVolumeTestJSON-2050431149-project] 10.222.0.58 "GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043" status: 404 len: 111 microversion: 2.1 time: 0.028530 May 17 12:16:46.281774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 473/961] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:16:46 2022] GET /compute/v2.1/servers/7d7d37bf-7c1d-43d6-9ede-a2e330b5a043 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 12:17:01.677493 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-513742ae-3a58-45af-99ba-267a0d2ea557 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:01.678492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-513742ae-3a58-45af-99ba-267a0d2ea557 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:01.684716 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-513742ae-3a58-45af-99ba-267a0d2ea557 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:01.685166 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-513742ae-3a58-45af-99ba-267a0d2ea557 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:01.685924 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-513742ae-3a58-45af-99ba-267a0d2ea557 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:01.686354 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-513742ae-3a58-45af-99ba-267a0d2ea557 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:01.755785 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-513742ae-3a58-45af-99ba-267a0d2ea557 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "POST /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/action" status: 202 len: 0 microversion: 2.1 time: 0.081751 May 17 12:17:01.758760 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 489/962] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:17:01 2022] POST /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:17:01.764568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0c19c895-1843-493f-a242-1043389e4305 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:01.765772 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0c19c895-1843-493f-a242-1043389e4305 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:01.773437 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0c19c895-1843-493f-a242-1043389e4305 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:01.773918 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0c19c895-1843-493f-a242-1043389e4305 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:01.774771 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0c19c895-1843-493f-a242-1043389e4305 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:01.775237 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0c19c895-1843-493f-a242-1043389e4305 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:01.918907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0c19c895-1843-493f-a242-1043389e4305 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:01.926910 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0c19c895-1843-493f-a242-1043389e4305 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1752 microversion: 2.1 time: 0.165970 May 17 12:17:01.927490 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 474/963] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:01 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:17:02.945480 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-267bddd5-e1b2-4739-aab0-df888e2f336d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:02.946095 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-267bddd5-e1b2-4739-aab0-df888e2f336d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:02.952515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-267bddd5-e1b2-4739-aab0-df888e2f336d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:02.953037 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-267bddd5-e1b2-4739-aab0-df888e2f336d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:02.953926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-267bddd5-e1b2-4739-aab0-df888e2f336d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:02.954478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-267bddd5-e1b2-4739-aab0-df888e2f336d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:03.106371 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-267bddd5-e1b2-4739-aab0-df888e2f336d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:03.115316 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-267bddd5-e1b2-4739-aab0-df888e2f336d tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1757 microversion: 2.1 time: 0.175323 May 17 12:17:03.115895 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 490/964] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:02 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:04.133286 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1e675f85-a3b8-453e-a8fd-8dde522ed0fc tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:04.133966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1e675f85-a3b8-453e-a8fd-8dde522ed0fc tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:04.140513 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1e675f85-a3b8-453e-a8fd-8dde522ed0fc tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:04.141070 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1e675f85-a3b8-453e-a8fd-8dde522ed0fc tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:04.141930 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1e675f85-a3b8-453e-a8fd-8dde522ed0fc tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:04.142438 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1e675f85-a3b8-453e-a8fd-8dde522ed0fc tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:04.286354 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1e675f85-a3b8-453e-a8fd-8dde522ed0fc tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:04.294289 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1e675f85-a3b8-453e-a8fd-8dde522ed0fc tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1757 microversion: 2.1 time: 0.165459 May 17 12:17:04.294938 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 475/965] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:04 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:05.312773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f2e8e947-0740-4729-9a0f-ad550256f0ee tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:05.313463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f2e8e947-0740-4729-9a0f-ad550256f0ee tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:05.320986 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2e8e947-0740-4729-9a0f-ad550256f0ee tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:05.321512 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2e8e947-0740-4729-9a0f-ad550256f0ee tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:05.322221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2e8e947-0740-4729-9a0f-ad550256f0ee tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:05.322663 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f2e8e947-0740-4729-9a0f-ad550256f0ee tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:05.627160 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f2e8e947-0740-4729-9a0f-ad550256f0ee tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:05.635481 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f2e8e947-0740-4729-9a0f-ad550256f0ee tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1757 microversion: 2.1 time: 0.326661 May 17 12:17:05.636036 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 491/966] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:05 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1757 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:05.737857 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-32c211da-7616-4ecf-baa7-5b1e5b35a8a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:05.738406 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-32c211da-7616-4ecf-baa7-5b1e5b35a8a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:05.745035 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-32c211da-7616-4ecf-baa7-5b1e5b35a8a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:05.745555 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-32c211da-7616-4ecf-baa7-5b1e5b35a8a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:05.746401 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-32c211da-7616-4ecf-baa7-5b1e5b35a8a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:05.746841 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-32c211da-7616-4ecf-baa7-5b1e5b35a8a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:05.770755 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-32c211da-7616-4ecf-baa7-5b1e5b35a8a4 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/ips" status: 200 len: 148 microversion: 2.1 time: 0.036801 May 17 12:17:05.771334 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 476/967] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 17 12:17:05 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:17:06.652665 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-826df199-a24b-41da-af43-2c3815d643a3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:06.653292 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-826df199-a24b-41da-af43-2c3815d643a3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:06.659620 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-826df199-a24b-41da-af43-2c3815d643a3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:06.660071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-826df199-a24b-41da-af43-2c3815d643a3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:06.661271 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-826df199-a24b-41da-af43-2c3815d643a3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:06.661801 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-826df199-a24b-41da-af43-2c3815d643a3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:06.808484 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-826df199-a24b-41da-af43-2c3815d643a3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:06.816169 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-826df199-a24b-41da-af43-2c3815d643a3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1757 microversion: 2.1 time: 0.167327 May 17 12:17:06.817427 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 492/968] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:06 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:07.101135 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-db51cc89-51c9-40b7-9bac-e957bb9aeef9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdd6849f-bd19-4bc6-8593-69973cf6b3b5"}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:07.102226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-db51cc89-51c9-40b7-9bac-e957bb9aeef9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:07.108418 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db51cc89-51c9-40b7-9bac-e957bb9aeef9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:07.108887 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db51cc89-51c9-40b7-9bac-e957bb9aeef9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:07.109675 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db51cc89-51c9-40b7-9bac-e957bb9aeef9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:07.110114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db51cc89-51c9-40b7-9bac-e957bb9aeef9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:07.367844 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-db51cc89-51c9-40b7-9bac-e957bb9aeef9 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "POST /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271368 May 17 12:17:07.368931 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 477/969] 10.222.0.58 () {60 vars in 1322 bytes} [Tue May 17 12:17:07 2022] POST /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:17:07.834640 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3c3c6cb0-fbad-4361-be48-f99c873129ca tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:07.835952 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3c3c6cb0-fbad-4361-be48-f99c873129ca tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:07.842406 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c3c6cb0-fbad-4361-be48-f99c873129ca tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:07.842850 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c3c6cb0-fbad-4361-be48-f99c873129ca tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:07.843617 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c3c6cb0-fbad-4361-be48-f99c873129ca tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:07.844050 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3c3c6cb0-fbad-4361-be48-f99c873129ca tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:07.999717 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3c3c6cb0-fbad-4361-be48-f99c873129ca tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:08.008555 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3c3c6cb0-fbad-4361-be48-f99c873129ca tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1757 microversion: 2.1 time: 0.177721 May 17 12:17:08.009117 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 493/970] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:07 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:09.025881 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-08c9bdaa-485f-4152-ac0d-a6ba0a1f0723 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:09.026620 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-08c9bdaa-485f-4152-ac0d-a6ba0a1f0723 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:09.032833 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08c9bdaa-485f-4152-ac0d-a6ba0a1f0723 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:09.033287 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08c9bdaa-485f-4152-ac0d-a6ba0a1f0723 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:09.034056 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08c9bdaa-485f-4152-ac0d-a6ba0a1f0723 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:09.034488 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-08c9bdaa-485f-4152-ac0d-a6ba0a1f0723 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:09.175702 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-08c9bdaa-485f-4152-ac0d-a6ba0a1f0723 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:09.184200 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-08c9bdaa-485f-4152-ac0d-a6ba0a1f0723 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1757 microversion: 2.1 time: 0.162945 May 17 12:17:09.184796 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 478/971] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:09 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:10.201965 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2259e91b-af73-40b3-8fd8-601e8f15d608 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:10.202583 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2259e91b-af73-40b3-8fd8-601e8f15d608 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:10.209137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2259e91b-af73-40b3-8fd8-601e8f15d608 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:10.209590 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2259e91b-af73-40b3-8fd8-601e8f15d608 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:10.210361 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2259e91b-af73-40b3-8fd8-601e8f15d608 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:10.210798 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2259e91b-af73-40b3-8fd8-601e8f15d608 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:10.359546 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2259e91b-af73-40b3-8fd8-601e8f15d608 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:10.368343 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2259e91b-af73-40b3-8fd8-601e8f15d608 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1757 microversion: 2.1 time: 0.170287 May 17 12:17:10.368907 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 494/972] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:10 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:11.385794 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f2dbccf6-dd35-43cc-9c42-d05d3b557b44 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:11.386411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f2dbccf6-dd35-43cc-9c42-d05d3b557b44 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:11.392725 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f2dbccf6-dd35-43cc-9c42-d05d3b557b44 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:11.393174 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f2dbccf6-dd35-43cc-9c42-d05d3b557b44 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:11.393932 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f2dbccf6-dd35-43cc-9c42-d05d3b557b44 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:11.394367 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f2dbccf6-dd35-43cc-9c42-d05d3b557b44 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:11.541667 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f2dbccf6-dd35-43cc-9c42-d05d3b557b44 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:11.549572 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f2dbccf6-dd35-43cc-9c42-d05d3b557b44 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1757 microversion: 2.1 time: 0.167557 May 17 12:17:11.550156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 479/973] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:11 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:12.567818 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d49e1a45-7b27-4226-ab39-1b28b205e7db tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:12.568469 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-d49e1a45-7b27-4226-ab39-1b28b205e7db tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:12.574365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d49e1a45-7b27-4226-ab39-1b28b205e7db tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:12.575058 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d49e1a45-7b27-4226-ab39-1b28b205e7db tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:12.575831 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d49e1a45-7b27-4226-ab39-1b28b205e7db tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:12.576300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-d49e1a45-7b27-4226-ab39-1b28b205e7db tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:12.719029 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-d49e1a45-7b27-4226-ab39-1b28b205e7db tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:12.727512 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d49e1a45-7b27-4226-ab39-1b28b205e7db tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1757 microversion: 2.1 time: 0.164150 May 17 12:17:12.728077 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 495/974] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:12 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:13.744948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0536bba2-9849-4e66-bc44-ccb31087ef56 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:13.745953 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0536bba2-9849-4e66-bc44-ccb31087ef56 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:13.751934 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0536bba2-9849-4e66-bc44-ccb31087ef56 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:13.752408 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0536bba2-9849-4e66-bc44-ccb31087ef56 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:13.753179 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0536bba2-9849-4e66-bc44-ccb31087ef56 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:13.753614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0536bba2-9849-4e66-bc44-ccb31087ef56 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:13.911633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0536bba2-9849-4e66-bc44-ccb31087ef56 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:13.919430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0536bba2-9849-4e66-bc44-ccb31087ef56 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1757 microversion: 2.1 time: 0.178148 May 17 12:17:13.920058 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 480/975] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:13 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:14.937279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f0a1dd65-e948-4abc-9397-dd62bea3ddb7 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:14.938010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f0a1dd65-e948-4abc-9397-dd62bea3ddb7 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:14.945409 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f0a1dd65-e948-4abc-9397-dd62bea3ddb7 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:14.946019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f0a1dd65-e948-4abc-9397-dd62bea3ddb7 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:14.946851 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f0a1dd65-e948-4abc-9397-dd62bea3ddb7 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:14.947471 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f0a1dd65-e948-4abc-9397-dd62bea3ddb7 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:15.100767 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f0a1dd65-e948-4abc-9397-dd62bea3ddb7 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:15.108983 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f0a1dd65-e948-4abc-9397-dd62bea3ddb7 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1760 microversion: 2.1 time: 0.175729 May 17 12:17:15.109553 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 496/976] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:14 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1760 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:16.005084 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d3acfaa5-3b79-4b00-ab4f-16999bc6df7f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:16.005561 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d3acfaa5-3b79-4b00-ab4f-16999bc6df7f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:16.011930 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d3acfaa5-3b79-4b00-ab4f-16999bc6df7f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:16.012422 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d3acfaa5-3b79-4b00-ab4f-16999bc6df7f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:16.013187 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d3acfaa5-3b79-4b00-ab4f-16999bc6df7f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:16.013620 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d3acfaa5-3b79-4b00-ab4f-16999bc6df7f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:16.090597 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-d3acfaa5-3b79-4b00-ab4f-16999bc6df7f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lazy-loading 'services' on Instance uuid b3ac4c1c-c934-4d40-9e9a-3378d9537069 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:17:16.162008 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d3acfaa5-3b79-4b00-ab4f-16999bc6df7f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/os-volume_attachments/fdd6849f-bd19-4bc6-8593-69973cf6b3b5" status: 202 len: 0 microversion: 2.1 time: 0.160711 May 17 12:17:16.162631 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 481/977] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:17:15 2022] DELETE /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/os-volume_attachments/fdd6849f-bd19-4bc6-8593-69973cf6b3b5 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:17:16.172675 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b9f94e69-e765-4b5d-aed1-59c7a9cb8352 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:16.174547 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b9f94e69-e765-4b5d-aed1-59c7a9cb8352 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:16.183045 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b9f94e69-e765-4b5d-aed1-59c7a9cb8352 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:16.184542 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b9f94e69-e765-4b5d-aed1-59c7a9cb8352 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:16.185721 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b9f94e69-e765-4b5d-aed1-59c7a9cb8352 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:16.186320 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b9f94e69-e765-4b5d-aed1-59c7a9cb8352 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:16.221751 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b9f94e69-e765-4b5d-aed1-59c7a9cb8352 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054655 May 17 12:17:16.222350 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 497/978] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:17:16 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:17:17.235005 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-7860fd83-8299-4768-8fe0-79c9aa4b27b7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:17.236138 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-7860fd83-8299-4768-8fe0-79c9aa4b27b7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:17.242377 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7860fd83-8299-4768-8fe0-79c9aa4b27b7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:17.242822 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7860fd83-8299-4768-8fe0-79c9aa4b27b7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:17.243588 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7860fd83-8299-4768-8fe0-79c9aa4b27b7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:17.244021 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-7860fd83-8299-4768-8fe0-79c9aa4b27b7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:17.271874 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-7860fd83-8299-4768-8fe0-79c9aa4b27b7 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041614 May 17 12:17:17.272450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 482/979] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:17:17 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 12:17:17.327246 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bda98d3d-5ea6-4a6b-84e6-828e83e5313e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:17.327760 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bda98d3d-5ea6-4a6b-84e6-828e83e5313e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:17.337680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bda98d3d-5ea6-4a6b-84e6-828e83e5313e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:17.338141 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bda98d3d-5ea6-4a6b-84e6-828e83e5313e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:17.338917 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bda98d3d-5ea6-4a6b-84e6-828e83e5313e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:17.339363 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bda98d3d-5ea6-4a6b-84e6-828e83e5313e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:17.364487 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bda98d3d-5ea6-4a6b-84e6-828e83e5313e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:17:17.444208 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bda98d3d-5ea6-4a6b-84e6-828e83e5313e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 204 len: 0 microversion: 2.1 time: 0.121089 May 17 12:17:17.444980 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 498/980] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:17:17 2022] DELETE /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:17:17.453501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-987e1a07-2bf8-4911-9dc4-c9a8fec2064e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:17.454114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-987e1a07-2bf8-4911-9dc4-c9a8fec2064e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:17.460682 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-987e1a07-2bf8-4911-9dc4-c9a8fec2064e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:17.461127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-987e1a07-2bf8-4911-9dc4-c9a8fec2064e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:17.461895 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-987e1a07-2bf8-4911-9dc4-c9a8fec2064e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:17.462327 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-987e1a07-2bf8-4911-9dc4-c9a8fec2064e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:17.594514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-987e1a07-2bf8-4911-9dc4-c9a8fec2064e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:17.602487 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-987e1a07-2bf8-4911-9dc4-c9a8fec2064e tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1680 microversion: 2.1 time: 0.153134 May 17 12:17:17.603064 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 483/981] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:17 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:18.619807 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6a667ce6-5145-42dc-854b-fd467b91df55 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:18.620684 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6a667ce6-5145-42dc-854b-fd467b91df55 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:18.627319 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6a667ce6-5145-42dc-854b-fd467b91df55 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:18.627684 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6a667ce6-5145-42dc-854b-fd467b91df55 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:18.628562 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6a667ce6-5145-42dc-854b-fd467b91df55 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:18.629001 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6a667ce6-5145-42dc-854b-fd467b91df55 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:18.867495 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6a667ce6-5145-42dc-854b-fd467b91df55 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:18.874922 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6a667ce6-5145-42dc-854b-fd467b91df55 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1680 microversion: 2.1 time: 0.259373 May 17 12:17:18.875572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 499/982] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:18 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:19.892560 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a61235b3-9278-4551-91bb-7d04ce92ad6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:19.893396 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a61235b3-9278-4551-91bb-7d04ce92ad6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:19.900411 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a61235b3-9278-4551-91bb-7d04ce92ad6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:19.901172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a61235b3-9278-4551-91bb-7d04ce92ad6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:19.902045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a61235b3-9278-4551-91bb-7d04ce92ad6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:19.902549 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a61235b3-9278-4551-91bb-7d04ce92ad6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:20.049069 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a61235b3-9278-4551-91bb-7d04ce92ad6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:20.057889 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a61235b3-9278-4551-91bb-7d04ce92ad6f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1680 microversion: 2.1 time: 0.169090 May 17 12:17:20.058480 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 484/983] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:19 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:20.496368 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-c0dfeb76-3a3c-4757-a6f8-c86b1cbaba1a req-fb2c5062-6dc9-46a0-adb0-2f69a0eea1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ac4c1c-c934-4d40-9e9a-3378d9537069", "name": "network-vif-deleted", "tag": "d332f149-b4a0-45ae-8eb9-e1266bcf6090"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:20.512348 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-c0dfeb76-3a3c-4757-a6f8-c86b1cbaba1a req-fb2c5062-6dc9-46a0-adb0-2f69a0eea1ff service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:20.512811 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-c0dfeb76-3a3c-4757-a6f8-c86b1cbaba1a req-fb2c5062-6dc9-46a0-adb0-2f69a0eea1ff service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:20.544401 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-c0dfeb76-3a3c-4757-a6f8-c86b1cbaba1a req-fb2c5062-6dc9-46a0-adb0-2f69a0eea1ff service nova] Creating event network-vif-deleted:d332f149-b4a0-45ae-8eb9-e1266bcf6090 for instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 on hv-cinder-83769 May 17 12:17:20.552932 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-c0dfeb76-3a3c-4757-a6f8-c86b1cbaba1a req-fb2c5062-6dc9-46a0-adb0-2f69a0eea1ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067700 May 17 12:17:20.554091 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 500/984] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:17:21.075488 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:21.076836 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:21.085248 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:21.085841 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:21.095277 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:21.095277 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:21.123421 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:21.124322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:21.124990 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lazy-loading 'fault' on Instance uuid b3ac4c1c-c934-4d40-9e9a-3378d9537069 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:17:21.185240 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586e15d5d16543e6b70c87fbf9079e9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27acd98621cd4a51ac46fb12e1824168', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:21.193082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-bc8a00e9-06b8-454e-abc6-54cf05050ce3 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 200 len: 1331 microversion: 2.1 time: 0.121817 May 17 12:17:21.193963 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 485/985] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:21 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:22.211500 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f8d05ee4-184e-4bc7-bc72-5646920934b0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:22.212314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f8d05ee4-184e-4bc7-bc72-5646920934b0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:22.218392 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f8d05ee4-184e-4bc7-bc72-5646920934b0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:22.218841 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f8d05ee4-184e-4bc7-bc72-5646920934b0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:22.219603 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f8d05ee4-184e-4bc7-bc72-5646920934b0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:22.220039 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f8d05ee4-184e-4bc7-bc72-5646920934b0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:22.233234 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-f8d05ee4-184e-4bc7-bc72-5646920934b0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f8d05ee4-184e-4bc7-bc72-5646920934b0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 HTTP/1.1 May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:17:22.234809 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:22.236438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'b3ac4c1c-c934-4d40-9e9a-3378d9537069'} May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:22.237283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:22.238586 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:22.240369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f8d05ee4-184e-4bc7-bc72-5646920934b0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:22.240369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f8d05ee4-184e-4bc7-bc72-5646920934b0 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 404 len: 111 microversion: 2.1 time: 0.029376 May 17 12:17:22.240369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 501/986] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:22 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:17:22.245636 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5921590f-f444-4b3b-bb29-ed3f328c951b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '.version_select at 0x7f2db4308c10>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:22.262409 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5921590f-f444-4b3b-bb29-ed3f328c951b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626563116" status: 202 len: 0 microversion: 2.1 time: 0.020525 May 17 12:17:22.263013 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 486/987] 10.222.0.58 () {58 vars in 1217 bytes} [Tue May 17 12:17:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626563116 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:17:22.703465 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-870650770", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "networks": [{"uuid": "49f3cb23-6bce-4173-805c-bcdc334068cb"}]}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:22.760228 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.network.neutron [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] validate_networks() for [('49f3cb23-6bce-4173-805c-bcdc334068cb', None, None, None, None, None)] {{(pid=117114) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:17:23.119675 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Flavor limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:17:23.120105 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Image limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:17:23.120631 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Flavor pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:17:23.121046 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Image pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:17:23.121463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:17:23.130739 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:23.131196 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:23.132005 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:23.132467 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:23.149128 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Getting quotas for project f55775e2790046029256efb09b501c89. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:17:23.152986 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Getting quotas for user 291b520eed8f446b86296165fb5d658a and project f55775e2790046029256efb09b501c89. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:17:23.163727 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Going to run 1 instances... {{(pid=117114) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:17:23.165984 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:17:23.212227 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-41a9dde0-d1c1-4ece-a4cb-78fd6d5f9886 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513025 May 17 12:17:23.212935 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 502/988] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:17:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:17:23.223843 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ddf90050-58c6-47b4-818f-e7caf3cd2626 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:23.224510 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ddf90050-58c6-47b4-818f-e7caf3cd2626 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:23.277543 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-ddf90050-58c6-47b4-818f-e7caf3cd2626 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:23.285037 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ddf90050-58c6-47b4-818f-e7caf3cd2626 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1213 microversion: 2.1 time: 0.065791 May 17 12:17:23.285612 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 487/989] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:23 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:23.998366 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a354668e-efd0-4638-b2f1-d600ac718247 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:23.998866 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a354668e-efd0-4638-b2f1-d600ac718247 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:24.006421 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a354668e-efd0-4638-b2f1-d600ac718247 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:24.006870 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a354668e-efd0-4638-b2f1-d600ac718247 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:24.007635 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a354668e-efd0-4638-b2f1-d600ac718247 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:24.008072 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a354668e-efd0-4638-b2f1-d600ac718247 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:24.020933 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-a354668e-efd0-4638-b2f1-d600ac718247 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a354668e-efd0-4638-b2f1-d600ac718247 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: DELETE /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 HTTP/1.1 May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:17:24.022458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:24.024043 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'b3ac4c1c-c934-4d40-9e9a-3378d9537069'} May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:24.024916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:24.026357 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:24.027875 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a354668e-efd0-4638-b2f1-d600ac718247 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:24.027875 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a354668e-efd0-4638-b2f1-d600ac718247 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 404 len: 111 microversion: 2.1 time: 0.029389 May 17 12:17:24.027875 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 503/990] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:17:23 2022] DELETE /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 12:17:24.032215 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e63c34d8-a678-4652-b6ea-7bca81fae829 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:24.032848 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e63c34d8-a678-4652-b6ea-7bca81fae829 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: b3ac4c1c-c934-4d40-9e9a-3378d9537069] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:24.038772 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e63c34d8-a678-4652-b6ea-7bca81fae829 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:24.039227 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e63c34d8-a678-4652-b6ea-7bca81fae829 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:24.039998 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e63c34d8-a678-4652-b6ea-7bca81fae829 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:24.040481 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e63c34d8-a678-4652-b6ea-7bca81fae829 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:24.053986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-e63c34d8-a678-4652-b6ea-7bca81fae829 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e63c34d8-a678-4652-b6ea-7bca81fae829 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 HTTP/1.1 May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:17:24.055596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:24.057006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'b3ac4c1c-c934-4d40-9e9a-3378d9537069'} May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:24.057730 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. May 17 12:17:24.058973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:24.060268 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e63c34d8-a678-4652-b6ea-7bca81fae829 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance b3ac4c1c-c934-4d40-9e9a-3378d9537069 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:24.060268 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e63c34d8-a678-4652-b6ea-7bca81fae829 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069" status: 404 len: 111 microversion: 2.1 time: 0.028610 May 17 12:17:24.060268 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 488/991] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:24 2022] GET /compute/v2.1/servers/b3ac4c1c-c934-4d40-9e9a-3378d9537069 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:17:24.302915 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3af71d08-7079-439a-8207-46cb4593b1f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:24.304349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3af71d08-7079-439a-8207-46cb4593b1f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:24.311204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3af71d08-7079-439a-8207-46cb4593b1f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:24.311918 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3af71d08-7079-439a-8207-46cb4593b1f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:24.313596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3af71d08-7079-439a-8207-46cb4593b1f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:24.314192 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3af71d08-7079-439a-8207-46cb4593b1f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:24.395670 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3af71d08-7079-439a-8207-46cb4593b1f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:24.403050 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3af71d08-7079-439a-8207-46cb4593b1f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1283 microversion: 2.1 time: 0.104607 May 17 12:17:24.403632 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 504/992] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:24 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:25.191002 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b3afcc2b-f995-49d6-8ceb-7a91ba6f5e44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:25.191617 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b3afcc2b-f995-49d6-8ceb-7a91ba6f5e44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:25.198680 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b3afcc2b-f995-49d6-8ceb-7a91ba6f5e44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.199136 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b3afcc2b-f995-49d6-8ceb-7a91ba6f5e44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.200160 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b3afcc2b-f995-49d6-8ceb-7a91ba6f5e44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.200626 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b3afcc2b-f995-49d6-8ceb-7a91ba6f5e44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.214590 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-b3afcc2b-f995-49d6-8ceb-7a91ba6f5e44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b3afcc2b-f995-49d6-8ceb-7a91ba6f5e44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: DELETE /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 HTTP/1.1 May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:17:25.216130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:17:25.217705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'e58ca2e7-3e3c-4fa8-a58c-214808748479'} May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:25.218614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:17:25.220439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:25.222518 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b3afcc2b-f995-49d6-8ceb-7a91ba6f5e44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:25.222518 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b3afcc2b-f995-49d6-8ceb-7a91ba6f5e44 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 404 len: 111 microversion: 2.1 time: 0.030421 May 17 12:17:25.222518 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 489/993] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:17:25 2022] DELETE /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:17:25.225956 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5fe3b6d0-a83d-402f-8585-85ae41ff5c4f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:25.226574 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5fe3b6d0-a83d-402f-8585-85ae41ff5c4f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: e58ca2e7-3e3c-4fa8-a58c-214808748479] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:25.232292 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5fe3b6d0-a83d-402f-8585-85ae41ff5c4f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.232742 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5fe3b6d0-a83d-402f-8585-85ae41ff5c4f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.233513 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5fe3b6d0-a83d-402f-8585-85ae41ff5c4f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.233944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5fe3b6d0-a83d-402f-8585-85ae41ff5c4f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.246947 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-5fe3b6d0-a83d-402f-8585-85ae41ff5c4f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5fe3b6d0-a83d-402f-8585-85ae41ff5c4f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 HTTP/1.1 May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:17:25.248478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:17:25.250017 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'e58ca2e7-3e3c-4fa8-a58c-214808748479'} May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:25.250858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. May 17 12:17:25.252349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:25.253589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5fe3b6d0-a83d-402f-8585-85ae41ff5c4f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance e58ca2e7-3e3c-4fa8-a58c-214808748479 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:25.253589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5fe3b6d0-a83d-402f-8585-85ae41ff5c4f tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479" status: 404 len: 111 microversion: 2.1 time: 0.027724 May 17 12:17:25.253589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 505/994] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:25 2022] GET /compute/v2.1/servers/e58ca2e7-3e3c-4fa8-a58c-214808748479 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:17:25.259568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-59f76334-b427-4588-b210-778a85a9e86b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:25.260069 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-59f76334-b427-4588-b210-778a85a9e86b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:25.265867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-59f76334-b427-4588-b210-778a85a9e86b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.266318 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-59f76334-b427-4588-b210-778a85a9e86b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.267079 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-59f76334-b427-4588-b210-778a85a9e86b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.267512 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-59f76334-b427-4588-b210-778a85a9e86b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.282806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-59f76334-b427-4588-b210-778a85a9e86b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-59f76334-b427-4588-b210-778a85a9e86b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: DELETE /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 HTTP/1.1 May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:17:25.284366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:17:25.286157 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '3692e0a7-74c5-43c9-8047-bc13959c2db7'} May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:25.287098 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:17:25.288768 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:25.290366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-59f76334-b427-4588-b210-778a85a9e86b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:25.290366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-59f76334-b427-4588-b210-778a85a9e86b tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 404 len: 111 microversion: 2.1 time: 0.030128 May 17 12:17:25.290366 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 490/995] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:17:25 2022] DELETE /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:17:25.294526 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b0ece32e-4465-4c09-8a05-42bda610aa27 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:25.295147 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b0ece32e-4465-4c09-8a05-42bda610aa27 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: 3692e0a7-74c5-43c9-8047-bc13959c2db7] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:25.301384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b0ece32e-4465-4c09-8a05-42bda610aa27 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.301834 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b0ece32e-4465-4c09-8a05-42bda610aa27 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.302636 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b0ece32e-4465-4c09-8a05-42bda610aa27 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.303051 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b0ece32e-4465-4c09-8a05-42bda610aa27 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.316413 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-b0ece32e-4465-4c09-8a05-42bda610aa27 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b0ece32e-4465-4c09-8a05-42bda610aa27 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 HTTP/1.1 May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:17:25.318492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:17:25.320300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '3692e0a7-74c5-43c9-8047-bc13959c2db7'} May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:25.321131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. May 17 12:17:25.322769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:25.324105 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b0ece32e-4465-4c09-8a05-42bda610aa27 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance 3692e0a7-74c5-43c9-8047-bc13959c2db7 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:25.324105 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b0ece32e-4465-4c09-8a05-42bda610aa27 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7" status: 404 len: 111 microversion: 2.1 time: 0.029398 May 17 12:17:25.324105 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 506/996] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:25 2022] GET /compute/v2.1/servers/3692e0a7-74c5-43c9-8047-bc13959c2db7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 12:17:25.419792 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-1bc5a9e3-c9c3-4568-809d-12d62a34b0d9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:25.420379 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-1bc5a9e3-c9c3-4568-809d-12d62a34b0d9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:25.426935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1bc5a9e3-c9c3-4568-809d-12d62a34b0d9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.427611 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1bc5a9e3-c9c3-4568-809d-12d62a34b0d9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.428571 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1bc5a9e3-c9c3-4568-809d-12d62a34b0d9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.429158 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-1bc5a9e3-c9c3-4568-809d-12d62a34b0d9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.561248 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-1bc5a9e3-c9c3-4568-809d-12d62a34b0d9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:25.563945 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-ecee80b9-78aa-4eab-9785-6f6cc8e82122 req-24f756bd-5368-4211-9d96-ad1363213e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3b1b152-078a-4044-b489-0ffc4e061fed", "tag": "9d598f14-a332-412f-bd09-ae5bc55fe7c5"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:25.573847 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-1bc5a9e3-c9c3-4568-809d-12d62a34b0d9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1313 microversion: 2.1 time: 0.157781 May 17 12:17:25.575508 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-ecee80b9-78aa-4eab-9785-6f6cc8e82122 req-24f756bd-5368-4211-9d96-ad1363213e1b service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:25.575869 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 491/997] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:25 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:25.576078 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-ecee80b9-78aa-4eab-9785-6f6cc8e82122 req-24f756bd-5368-4211-9d96-ad1363213e1b service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:25.587883 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-ecee80b9-78aa-4eab-9785-6f6cc8e82122 req-24f756bd-5368-4211-9d96-ad1363213e1b service nova] Creating event network-changed:9d598f14-a332-412f-bd09-ae5bc55fe7c5 for instance a3b1b152-078a-4044-b489-0ffc4e061fed on hv-cinder-83769 May 17 12:17:25.599678 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-ecee80b9-78aa-4eab-9785-6f6cc8e82122 req-24f756bd-5368-4211-9d96-ad1363213e1b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041939 May 17 12:17:25.600314 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 507/998] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:17:26.467761 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-43bcad68-5245-4443-8526-95dfa55e1dbb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:26.468348 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-43bcad68-5245-4443-8526-95dfa55e1dbb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:26.475316 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-43bcad68-5245-4443-8526-95dfa55e1dbb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:26.475763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-43bcad68-5245-4443-8526-95dfa55e1dbb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:26.476572 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-43bcad68-5245-4443-8526-95dfa55e1dbb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:26.477007 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-43bcad68-5245-4443-8526-95dfa55e1dbb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:26.490184 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-43bcad68-5245-4443-8526-95dfa55e1dbb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-43bcad68-5245-4443-8526-95dfa55e1dbb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: DELETE /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d HTTP/1.1 May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:17:26.491696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:17:26.493226 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'ed125da4-128c-4d7e-ae52-d42f71475d0d'} May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:26.494082 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:17:26.495569 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:26.497132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-43bcad68-5245-4443-8526-95dfa55e1dbb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:26.497132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-43bcad68-5245-4443-8526-95dfa55e1dbb tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 404 len: 111 microversion: 2.1 time: 0.029178 May 17 12:17:26.497132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 492/999] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:17:26 2022] DELETE /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:17:26.502435 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f10c5509-ea43-44c5-b56d-a24feb289e85 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:26.503128 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f10c5509-ea43-44c5-b56d-a24feb289e85 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] [instance: ed125da4-128c-4d7e-ae52-d42f71475d0d] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:26.509318 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f10c5509-ea43-44c5-b56d-a24feb289e85 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:26.509772 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f10c5509-ea43-44c5-b56d-a24feb289e85 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:26.510534 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f10c5509-ea43-44c5-b56d-a24feb289e85 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:26.510973 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f10c5509-ea43-44c5-b56d-a24feb289e85 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:26.524368 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-f10c5509-ea43-44c5-b56d-a24feb289e85 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] HTTP exception thrown: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f10c5509-ea43-44c5-b56d-a24feb289e85 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Request method failure captured: May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d HTTP/1.1 May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_SaNXMAkHNYNRVr2ktznkxcbvKuiJvSkpbM082uAZo9Umgzk2ah1m2zYlj6jbtonn1SWiyE-WMrUBY3ZBAhREwH--c0J5XoFnUOQozzQi93_bQy-AA5BiwSOyZrA-UH5mnO4tKDe9SKk7Xv7Z8BDqxDSpFFIxk3N_lYD680VdOL3g May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:17:26.526019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27acd98621cd4a51ac46fb12e1824168", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27acd98621cd4a51ac46fb12e1824168"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27acd98621cd4a51ac46fb12e1824168"}]}] May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 27acd98621cd4a51ac46fb12e1824168 May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1061468996 May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 586e15d5d16543e6b70c87fbf9079e9e May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeNegativeTest-1061468996-project May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:17:26.527661 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'ed125da4-128c-4d7e-ae52-d42f71475d0d'} May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:26.529099 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. May 17 12:17:26.530580 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:26.531891 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f10c5509-ea43-44c5-b56d-a24feb289e85 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] Returning 404 to user: Instance ed125da4-128c-4d7e-ae52-d42f71475d0d could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:26.531891 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f10c5509-ea43-44c5-b56d-a24feb289e85 tempest-AttachVolumeNegativeTest-1061468996 tempest-AttachVolumeNegativeTest-1061468996-project] 10.222.0.58 "GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d" status: 404 len: 111 microversion: 2.1 time: 0.029712 May 17 12:17:26.531891 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 508/1000] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:26 2022] GET /compute/v2.1/servers/ed125da4-128c-4d7e-ae52-d42f71475d0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 12:17:26.593172 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-547c5303-03f0-46f0-9a4d-8d38f86f7269 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:26.593899 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-547c5303-03f0-46f0-9a4d-8d38f86f7269 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:26.600614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-547c5303-03f0-46f0-9a4d-8d38f86f7269 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:26.601067 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-547c5303-03f0-46f0-9a4d-8d38f86f7269 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:26.601881 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-547c5303-03f0-46f0-9a4d-8d38f86f7269 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:26.602320 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-547c5303-03f0-46f0-9a4d-8d38f86f7269 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:26.813390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-547c5303-03f0-46f0-9a4d-8d38f86f7269 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:26.821227 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-547c5303-03f0-46f0-9a4d-8d38f86f7269 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1313 microversion: 2.1 time: 0.232504 May 17 12:17:26.822165 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 493/1001] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:26 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:27.838462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-eeb3674c-167b-4596-b456-6d891652ad73 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:27.839071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-eeb3674c-167b-4596-b456-6d891652ad73 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:27.845424 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eeb3674c-167b-4596-b456-6d891652ad73 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:27.845873 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eeb3674c-167b-4596-b456-6d891652ad73 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:27.846640 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eeb3674c-167b-4596-b456-6d891652ad73 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:27.847074 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eeb3674c-167b-4596-b456-6d891652ad73 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:27.979989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-eeb3674c-167b-4596-b456-6d891652ad73 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:27.987744 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-eeb3674c-167b-4596-b456-6d891652ad73 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1313 microversion: 2.1 time: 0.153064 May 17 12:17:27.988347 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 509/1002] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:27 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:29.005501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2c32540f-4a70-4576-a47a-04615c7dd23f tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:29.006228 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2c32540f-4a70-4576-a47a-04615c7dd23f tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:29.012626 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2c32540f-4a70-4576-a47a-04615c7dd23f tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:29.013148 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2c32540f-4a70-4576-a47a-04615c7dd23f tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:29.014231 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2c32540f-4a70-4576-a47a-04615c7dd23f tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:29.014750 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2c32540f-4a70-4576-a47a-04615c7dd23f tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:29.167211 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2c32540f-4a70-4576-a47a-04615c7dd23f tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:29.180627 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2c32540f-4a70-4576-a47a-04615c7dd23f tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1313 microversion: 2.1 time: 0.179050 May 17 12:17:29.181709 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 494/1003] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:29 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:29.402489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2f27a67e-4321-40ac-8d62-ac5f7535b391 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:29.404699 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2f27a67e-4321-40ac-8d62-ac5f7535b391 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:29.420494 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2f27a67e-4321-40ac-8d62-ac5f7535b391 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:29.421199 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2f27a67e-4321-40ac-8d62-ac5f7535b391 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:29.422157 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2f27a67e-4321-40ac-8d62-ac5f7535b391 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:29.422761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2f27a67e-4321-40ac-8d62-ac5f7535b391 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:29.457659 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2f27a67e-4321-40ac-8d62-ac5f7535b391 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058498 May 17 12:17:29.458545 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 510/1004] 10.222.0.58 () {60 vars in 1342 bytes} [Tue May 17 12:17:29 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:29.533322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d2429bba-e5fa-40cf-941d-837106481895 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:29.545750 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d2429bba-e5fa-40cf-941d-837106481895 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:29.554806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d2429bba-e5fa-40cf-941d-837106481895 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:29.554806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d2429bba-e5fa-40cf-941d-837106481895 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:29.554806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d2429bba-e5fa-40cf-941d-837106481895 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:29.554806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d2429bba-e5fa-40cf-941d-837106481895 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:29.600665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d2429bba-e5fa-40cf-941d-837106481895 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Going to try to terminate instance {{(pid=117113) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:17:29.693001 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d2429bba-e5fa-40cf-941d-837106481895 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 204 len: 0 microversion: 2.20 time: 0.163464 May 17 12:17:29.693708 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 495/1005] 10.222.0.58 () {60 vars in 1279 bytes} [Tue May 17 12:17:29 2022] DELETE /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 17 12:17:29.702506 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-985158cc-1a81-49b2-b25e-bae02f720ce6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:29.703379 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-985158cc-1a81-49b2-b25e-bae02f720ce6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:29.709773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-985158cc-1a81-49b2-b25e-bae02f720ce6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:29.710227 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-985158cc-1a81-49b2-b25e-bae02f720ce6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:29.711007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-985158cc-1a81-49b2-b25e-bae02f720ce6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:29.711455 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-985158cc-1a81-49b2-b25e-bae02f720ce6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:29.887048 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-985158cc-1a81-49b2-b25e-bae02f720ce6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:29.896395 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-985158cc-1a81-49b2-b25e-bae02f720ce6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:29.898212 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-985158cc-1a81-49b2-b25e-bae02f720ce6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:29.899569 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-985158cc-1a81-49b2-b25e-bae02f720ce6 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.201648 May 17 12:17:29.900605 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 511/1006] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:29 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:17:30.198230 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9272ed65-144e-405a-be44-3a51a7e4f656 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:30.198925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9272ed65-144e-405a-be44-3a51a7e4f656 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:30.205434 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9272ed65-144e-405a-be44-3a51a7e4f656 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:30.205897 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9272ed65-144e-405a-be44-3a51a7e4f656 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:30.206681 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9272ed65-144e-405a-be44-3a51a7e4f656 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:30.207119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9272ed65-144e-405a-be44-3a51a7e4f656 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:30.618859 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-9272ed65-144e-405a-be44-3a51a7e4f656 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:30.626053 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-9272ed65-144e-405a-be44-3a51a7e4f656 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1313 microversion: 2.1 time: 0.432229 May 17 12:17:30.626700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 496/1007] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:30 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:30.917693 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-74a90a6c-5788-4e0d-ab01-39ca0c800161 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:30.918310 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-74a90a6c-5788-4e0d-ab01-39ca0c800161 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:30.924601 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-74a90a6c-5788-4e0d-ab01-39ca0c800161 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:30.925061 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-74a90a6c-5788-4e0d-ab01-39ca0c800161 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:30.925838 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-74a90a6c-5788-4e0d-ab01-39ca0c800161 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:30.926813 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-74a90a6c-5788-4e0d-ab01-39ca0c800161 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:31.069554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-74a90a6c-5788-4e0d-ab01-39ca0c800161 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:31.078243 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-74a90a6c-5788-4e0d-ab01-39ca0c800161 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:31.080805 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-74a90a6c-5788-4e0d-ab01-39ca0c800161 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:31.082171 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-74a90a6c-5788-4e0d-ab01-39ca0c800161 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.168486 May 17 12:17:31.082938 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 512/1008] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:30 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:17:31.117649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-1fe74eeb-ac17-4e82-9365-659da4eb11ca req-c2bff0dc-0d5d-4328-8082-63d73f94a25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b1b152-078a-4044-b489-0ffc4e061fed", "name": "network-vif-plugged", "status": "completed", "tag": "9d598f14-a332-412f-bd09-ae5bc55fe7c5"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:31.126393 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-1fe74eeb-ac17-4e82-9365-659da4eb11ca req-c2bff0dc-0d5d-4328-8082-63d73f94a25c service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:31.126949 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-1fe74eeb-ac17-4e82-9365-659da4eb11ca req-c2bff0dc-0d5d-4328-8082-63d73f94a25c service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:31.138501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-1fe74eeb-ac17-4e82-9365-659da4eb11ca req-c2bff0dc-0d5d-4328-8082-63d73f94a25c service nova] Creating event network-vif-plugged:9d598f14-a332-412f-bd09-ae5bc55fe7c5 for instance a3b1b152-078a-4044-b489-0ffc4e061fed on hv-cinder-83769 May 17 12:17:31.143887 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-1fe74eeb-ac17-4e82-9365-659da4eb11ca req-c2bff0dc-0d5d-4328-8082-63d73f94a25c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030473 May 17 12:17:31.144870 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 497/1009] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:17:31.643062 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-aefd97c1-7fc3-4071-be75-9b5fbcd0e7e5 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:31.643748 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-aefd97c1-7fc3-4071-be75-9b5fbcd0e7e5 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:31.650471 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aefd97c1-7fc3-4071-be75-9b5fbcd0e7e5 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:31.650946 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aefd97c1-7fc3-4071-be75-9b5fbcd0e7e5 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:31.651734 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aefd97c1-7fc3-4071-be75-9b5fbcd0e7e5 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:31.652187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aefd97c1-7fc3-4071-be75-9b5fbcd0e7e5 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:31.779176 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-aefd97c1-7fc3-4071-be75-9b5fbcd0e7e5 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:31.786497 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-aefd97c1-7fc3-4071-be75-9b5fbcd0e7e5 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1313 microversion: 2.1 time: 0.147414 May 17 12:17:31.787063 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 513/1010] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:31 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:32.101568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-61d71933-7a99-495e-ba11-f7f7c114b24f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:32.102192 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-61d71933-7a99-495e-ba11-f7f7c114b24f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:32.108744 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-61d71933-7a99-495e-ba11-f7f7c114b24f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:32.109198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-61d71933-7a99-495e-ba11-f7f7c114b24f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:32.109997 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-61d71933-7a99-495e-ba11-f7f7c114b24f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:32.110438 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-61d71933-7a99-495e-ba11-f7f7c114b24f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:32.239104 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-61d71933-7a99-495e-ba11-f7f7c114b24f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:32.246802 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-61d71933-7a99-495e-ba11-f7f7c114b24f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:32.248338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-61d71933-7a99-495e-ba11-f7f7c114b24f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:32.249493 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-61d71933-7a99-495e-ba11-f7f7c114b24f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1722 microversion: 2.20 time: 0.152730 May 17 12:17:32.250063 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 498/1011] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:32 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:17:32.802913 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-025979f6-bdf6-4c7c-85ef-02b6aa86fe29 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:32.803579 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-025979f6-bdf6-4c7c-85ef-02b6aa86fe29 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:32.810531 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-025979f6-bdf6-4c7c-85ef-02b6aa86fe29 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:32.811137 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-025979f6-bdf6-4c7c-85ef-02b6aa86fe29 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:32.811987 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-025979f6-bdf6-4c7c-85ef-02b6aa86fe29 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:32.812511 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-025979f6-bdf6-4c7c-85ef-02b6aa86fe29 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:33.058907 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-025979f6-bdf6-4c7c-85ef-02b6aa86fe29 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:33.066527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-025979f6-bdf6-4c7c-85ef-02b6aa86fe29 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1313 microversion: 2.1 time: 0.267824 May 17 12:17:33.068251 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 514/1012] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:32 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:33.266887 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-de7dbaa8-cfcc-4c22-b0e6-6a864beead1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:33.267502 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-de7dbaa8-cfcc-4c22-b0e6-6a864beead1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:33.274011 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-de7dbaa8-cfcc-4c22-b0e6-6a864beead1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:33.274459 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-de7dbaa8-cfcc-4c22-b0e6-6a864beead1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:33.275225 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-de7dbaa8-cfcc-4c22-b0e6-6a864beead1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:33.275840 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-de7dbaa8-cfcc-4c22-b0e6-6a864beead1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:33.342474 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-de7dbaa8-cfcc-4c22-b0e6-6a864beead1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:33.351010 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-de7dbaa8-cfcc-4c22-b0e6-6a864beead1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:33.352565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-de7dbaa8-cfcc-4c22-b0e6-6a864beead1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:33.353723 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-de7dbaa8-cfcc-4c22-b0e6-6a864beead1c tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1656 microversion: 2.20 time: 0.090745 May 17 12:17:33.354290 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 499/1013] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:33 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:17:33.802581 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-bac61960-261f-41f6-9a56-8104bb2bebc2 req-cf4d7de9-4b71-4419-a349-cbd893f60838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23", "name": "network-vif-deleted", "tag": "3370c5ba-e7d7-4dab-8520-7a3da90d8b4a"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:33.810430 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-bac61960-261f-41f6-9a56-8104bb2bebc2 req-cf4d7de9-4b71-4419-a349-cbd893f60838 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:33.811010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-bac61960-261f-41f6-9a56-8104bb2bebc2 req-cf4d7de9-4b71-4419-a349-cbd893f60838 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:33.822300 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-bac61960-261f-41f6-9a56-8104bb2bebc2 req-cf4d7de9-4b71-4419-a349-cbd893f60838 service nova] Creating event network-vif-deleted:3370c5ba-e7d7-4dab-8520-7a3da90d8b4a for instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 on hv-cinder-83769 May 17 12:17:33.827779 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-bac61960-261f-41f6-9a56-8104bb2bebc2 req-cf4d7de9-4b71-4419-a349-cbd893f60838 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029169 May 17 12:17:33.828060 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 515/1014] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:17:34.084951 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4ba9f73b-8888-4620-9f5c-427aff712f68 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:34.085565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4ba9f73b-8888-4620-9f5c-427aff712f68 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:34.091314 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4ba9f73b-8888-4620-9f5c-427aff712f68 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:34.091761 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4ba9f73b-8888-4620-9f5c-427aff712f68 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:34.092567 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4ba9f73b-8888-4620-9f5c-427aff712f68 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:34.093027 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4ba9f73b-8888-4620-9f5c-427aff712f68 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:34.221204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4ba9f73b-8888-4620-9f5c-427aff712f68 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:34.231013 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4ba9f73b-8888-4620-9f5c-427aff712f68 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1498 microversion: 2.1 time: 0.150355 May 17 12:17:34.231725 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 500/1015] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:34 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:34.372279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-99fe7f1b-9688-4fde-bb39-2e936752e4d5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:34.372986 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-99fe7f1b-9688-4fde-bb39-2e936752e4d5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:34.378981 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-99fe7f1b-9688-4fde-bb39-2e936752e4d5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:34.379995 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-99fe7f1b-9688-4fde-bb39-2e936752e4d5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:34.380844 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-99fe7f1b-9688-4fde-bb39-2e936752e4d5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:34.381289 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-99fe7f1b-9688-4fde-bb39-2e936752e4d5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:34.451113 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-99fe7f1b-9688-4fde-bb39-2e936752e4d5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:34.459559 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-99fe7f1b-9688-4fde-bb39-2e936752e4d5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:34.461107 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-99fe7f1b-9688-4fde-bb39-2e936752e4d5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:34.462276 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-99fe7f1b-9688-4fde-bb39-2e936752e4d5 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1656 microversion: 2.20 time: 0.094306 May 17 12:17:34.462877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 516/1016] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:34 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1656 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:17:35.480244 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-474d8955-63aa-436e-81ea-7f7024561421 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:35.480862 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-474d8955-63aa-436e-81ea-7f7024561421 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:35.487219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-474d8955-63aa-436e-81ea-7f7024561421 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:35.487665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-474d8955-63aa-436e-81ea-7f7024561421 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:35.488467 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-474d8955-63aa-436e-81ea-7f7024561421 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:35.488978 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-474d8955-63aa-436e-81ea-7f7024561421 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:35.554457 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-474d8955-63aa-436e-81ea-7f7024561421 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:35.562245 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-474d8955-63aa-436e-81ea-7f7024561421 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:35.563775 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-474d8955-63aa-436e-81ea-7f7024561421 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:35.564940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-474d8955-63aa-436e-81ea-7f7024561421 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1656 microversion: 2.20 time: 0.088688 May 17 12:17:35.565500 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 501/1017] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:35 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1656 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:17:36.583034 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5dda73b4-13a0-4633-94cc-243388f5d3c9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:36.583647 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5dda73b4-13a0-4633-94cc-243388f5d3c9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:36.590205 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5dda73b4-13a0-4633-94cc-243388f5d3c9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:36.590797 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5dda73b4-13a0-4633-94cc-243388f5d3c9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:36.591858 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5dda73b4-13a0-4633-94cc-243388f5d3c9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:36.592500 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5dda73b4-13a0-4633-94cc-243388f5d3c9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:36.654272 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5dda73b4-13a0-4633-94cc-243388f5d3c9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:36.662425 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5dda73b4-13a0-4633-94cc-243388f5d3c9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:36.663916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5dda73b4-13a0-4633-94cc-243388f5d3c9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:36.665088 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5dda73b4-13a0-4633-94cc-243388f5d3c9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1656 microversion: 2.20 time: 0.086138 May 17 12:17:36.665643 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 517/1018] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:36 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:17:37.418096 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fee4c36e-06e6-4228-891b-d0597d578bc8 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:37.418638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fee4c36e-06e6-4228-891b-d0597d578bc8 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:37.424925 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fee4c36e-06e6-4228-891b-d0597d578bc8 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:37.425372 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fee4c36e-06e6-4228-891b-d0597d578bc8 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:37.426699 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fee4c36e-06e6-4228-891b-d0597d578bc8 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:37.427305 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fee4c36e-06e6-4228-891b-d0597d578bc8 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:37.452277 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fee4c36e-06e6-4228-891b-d0597d578bc8 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Going to try to terminate instance {{(pid=117113) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:17:37.523329 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fee4c36e-06e6-4228-891b-d0597d578bc8 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 204 len: 0 microversion: 2.1 time: 0.108754 May 17 12:17:37.523914 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 502/1019] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:17:37 2022] DELETE /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:17:37.532024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-95416deb-3282-45e7-b898-f83a25a8f2e4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:37.532655 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-95416deb-3282-45e7-b898-f83a25a8f2e4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:37.539575 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95416deb-3282-45e7-b898-f83a25a8f2e4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:37.540022 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95416deb-3282-45e7-b898-f83a25a8f2e4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:37.540820 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95416deb-3282-45e7-b898-f83a25a8f2e4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:37.541257 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-95416deb-3282-45e7-b898-f83a25a8f2e4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:37.672762 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-95416deb-3282-45e7-b898-f83a25a8f2e4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:37.680708 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-95416deb-3282-45e7-b898-f83a25a8f2e4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1504 microversion: 2.1 time: 0.152446 May 17 12:17:37.690209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 518/1020] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:37 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:17:37.690403 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:37.690403 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:37.690944 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:37.691523 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:37.693360 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:37.693806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:37.725085 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:37.725538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:37.725989 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lazy-loading 'fault' on Instance uuid b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:17:37.766922 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:37.774761 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:37.776289 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:37.777441 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-47d921ff-7733-443d-af9e-7a39aa5e33fa tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1372 microversion: 2.20 time: 0.097949 May 17 12:17:37.778015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 503/1021] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:37 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:17:38.698392 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-985995ad-062b-4333-ac04-01de3b796149 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:38.699007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-985995ad-062b-4333-ac04-01de3b796149 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:38.705671 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-985995ad-062b-4333-ac04-01de3b796149 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:38.706127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-985995ad-062b-4333-ac04-01de3b796149 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:38.706898 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-985995ad-062b-4333-ac04-01de3b796149 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:38.707338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-985995ad-062b-4333-ac04-01de3b796149 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:38.794698 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:38.795308 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:38.801551 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:38.802002 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:38.802989 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:38.803425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:38.836541 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-985995ad-062b-4333-ac04-01de3b796149 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:38.837085 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:38.837532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:38.837977 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lazy-loading 'fault' on Instance uuid b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:17:38.844031 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-985995ad-062b-4333-ac04-01de3b796149 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1504 microversion: 2.1 time: 0.149546 May 17 12:17:38.844625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 519/1022] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:38 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:38.880198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:38.888343 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:38.889826 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:38.890960 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-eb86b88a-6c5c-4319-b591-31aa3136240d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1372 microversion: 2.20 time: 0.100080 May 17 12:17:38.891524 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 504/1023] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:38 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:17:39.861502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-579efa01-ea14-4eb5-8ec7-6a989f042960 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:39.862098 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-579efa01-ea14-4eb5-8ec7-6a989f042960 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:39.868666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-579efa01-ea14-4eb5-8ec7-6a989f042960 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:39.869119 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-579efa01-ea14-4eb5-8ec7-6a989f042960 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:39.869893 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-579efa01-ea14-4eb5-8ec7-6a989f042960 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:39.870337 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-579efa01-ea14-4eb5-8ec7-6a989f042960 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:39.909201 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:39.909816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:39.917430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:39.917890 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:39.918683 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:39.919126 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:39.950225 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:39.950941 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:39.951128 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lazy-loading 'fault' on Instance uuid b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:17:39.992789 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:40.000591 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:40.002114 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:40.002245 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-579efa01-ea14-4eb5-8ec7-6a989f042960 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:40.003274 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c4f0ef2e-2e3f-41ce-adab-92540652f301 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1372 microversion: 2.20 time: 0.098022 May 17 12:17:40.003844 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 505/1024] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:39 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 12:17:40.010129 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-579efa01-ea14-4eb5-8ec7-6a989f042960 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1504 microversion: 2.1 time: 0.152523 May 17 12:17:40.010719 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 520/1025] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:39 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:41.021595 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:41.022145 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:41.028802 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-69ceb21b-15cc-4f4a-8a5b-cd783f9b0948 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:41.029321 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:41.029420 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:41.030380 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:41.030688 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-69ceb21b-15cc-4f4a-8a5b-cd783f9b0948 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:41.030916 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:41.038049 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-69ceb21b-15cc-4f4a-8a5b-cd783f9b0948 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:41.038504 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-69ceb21b-15cc-4f4a-8a5b-cd783f9b0948 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:41.039290 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-69ceb21b-15cc-4f4a-8a5b-cd783f9b0948 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:41.039761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-69ceb21b-15cc-4f4a-8a5b-cd783f9b0948 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:41.062572 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:41.063020 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:41.063466 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lazy-loading 'fault' on Instance uuid b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:17:41.103369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:41.111123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:41.112663 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:41.113819 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b565d642-dc85-4ceb-b1a2-f4829412b59d tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1372 microversion: 2.20 time: 0.096382 May 17 12:17:41.114384 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 506/1026] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:41 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:17:41.168618 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-69ceb21b-15cc-4f4a-8a5b-cd783f9b0948 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:41.175926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-69ceb21b-15cc-4f4a-8a5b-cd783f9b0948 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1504 microversion: 2.1 time: 0.152349 May 17 12:17:41.176523 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 521/1027] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:41 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:42.133027 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:42.133619 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:42.140037 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:42.140637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:42.141399 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:42.141838 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:42.173026 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:42.173472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:42.173912 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lazy-loading 'fault' on Instance uuid b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:17:42.194256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2d75a95b-9b93-4a4e-8706-4ef8de0f39e9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:42.194982 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2d75a95b-9b93-4a4e-8706-4ef8de0f39e9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:42.203226 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2d75a95b-9b93-4a4e-8706-4ef8de0f39e9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:42.203673 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2d75a95b-9b93-4a4e-8706-4ef8de0f39e9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:42.204481 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2d75a95b-9b93-4a4e-8706-4ef8de0f39e9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:42.204926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2d75a95b-9b93-4a4e-8706-4ef8de0f39e9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:42.221891 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:42.230938 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:42.232451 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8a6a76a94ca4fb197c7b1705b809c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2c9994923540748c1513406e3e7ffc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:42.233611 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0e366e70-929f-48b9-874d-d2f54419bd27 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 200 len: 1372 microversion: 2.20 time: 0.105336 May 17 12:17:42.234175 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 507/1028] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:42 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 12:17:42.390052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2d75a95b-9b93-4a4e-8706-4ef8de0f39e9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:42.397651 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2d75a95b-9b93-4a4e-8706-4ef8de0f39e9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1504 microversion: 2.1 time: 0.208680 May 17 12:17:42.398222 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 522/1029] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:42 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:17:43.252258 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d9f83baa-c793-4182-9c1f-fd511e2e4317 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:43.252876 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d9f83baa-c793-4182-9c1f-fd511e2e4317 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:43.259867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d9f83baa-c793-4182-9c1f-fd511e2e4317 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:43.260354 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d9f83baa-c793-4182-9c1f-fd511e2e4317 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:43.261127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d9f83baa-c793-4182-9c1f-fd511e2e4317 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:43.261565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d9f83baa-c793-4182-9c1f-fd511e2e4317 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:43.274942 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-d9f83baa-c793-4182-9c1f-fd511e2e4317 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] HTTP exception thrown: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d9f83baa-c793-4182-9c1f-fd511e2e4317 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Request method failure captured: May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 HTTP/1.1 May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_FF35wQCZYa_5R-rm3Al3m8tWE9gPaJAlaRYwQysw1zVZ7iCL1vxXAIpNoKJNNnbSpnGIY0GzbErBufU2yEqLY4BfaskjzAmlvB1bh0uEmgObKIWJAwOb309IlBfJOkqvbDK3B4uJlykOhrz-elL5Fyau25rG-hk7aqNaKhjSSEzs May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Openstack-Nova-Api-Version: 2.20 May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:17:43.276587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cd2c9994923540748c1513406e3e7ffc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}] May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: e8a6a76a94ca4fb197c7b1705b809c54 May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:43.278197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23'} May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:43.279022 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:43.280566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:43.281852 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d9f83baa-c793-4182-9c1f-fd511e2e4317 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Returning 404 to user: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:43.281852 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d9f83baa-c793-4182-9c1f-fd511e2e4317 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 404 len: 111 microversion: 2.20 time: 0.029621 May 17 12:17:43.281852 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 508/1030] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:43 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 12:17:43.286705 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-22944dab-31be-4d3c-aec2-a4cec47e677f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '.version_select at 0x7f2db4293af0>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:43.289926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR oslo.messaging._drivers.impl_rabbit [None req-22944dab-31be-4d3c-aec2-a4cec47e677f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [4e3d6092-0300-49e2-aadf-db48e3ec1ae3] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 12:17:43.414587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f56e647d-cba7-446c-858e-7f1b1b5ef5e7 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:43.415204 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f56e647d-cba7-446c-858e-7f1b1b5ef5e7 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:43.421196 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f56e647d-cba7-446c-858e-7f1b1b5ef5e7 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:43.421645 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f56e647d-cba7-446c-858e-7f1b1b5ef5e7 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:43.422418 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f56e647d-cba7-446c-858e-7f1b1b5ef5e7 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:43.422853 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f56e647d-cba7-446c-858e-7f1b1b5ef5e7 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:43.557107 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f56e647d-cba7-446c-858e-7f1b1b5ef5e7 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:43.564769 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f56e647d-cba7-446c-858e-7f1b1b5ef5e7 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1504 microversion: 2.1 time: 0.154038 May 17 12:17:43.565439 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 509/1031] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:43 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:17:44.274486 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-cb207871-9cad-41e8-bcdd-90b3b1aed626 req-21700ad3-eb3c-44ee-b257-5997de080b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3b1b152-078a-4044-b489-0ffc4e061fed", "name": "network-vif-deleted", "tag": "9d598f14-a332-412f-bd09-ae5bc55fe7c5"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:44.282941 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-cb207871-9cad-41e8-bcdd-90b3b1aed626 req-21700ad3-eb3c-44ee-b257-5997de080b7f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:44.283387 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-cb207871-9cad-41e8-bcdd-90b3b1aed626 req-21700ad3-eb3c-44ee-b257-5997de080b7f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:44.294972 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-cb207871-9cad-41e8-bcdd-90b3b1aed626 req-21700ad3-eb3c-44ee-b257-5997de080b7f service nova] Creating event network-vif-deleted:9d598f14-a332-412f-bd09-ae5bc55fe7c5 for instance a3b1b152-078a-4044-b489-0ffc4e061fed on hv-cinder-83769 May 17 12:17:44.299945 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO oslo.messaging._drivers.impl_rabbit [None req-22944dab-31be-4d3c-aec2-a4cec47e677f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [4e3d6092-0300-49e2-aadf-db48e3ec1ae3] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 57458. May 17 12:17:44.300519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-cb207871-9cad-41e8-bcdd-90b3b1aed626 req-21700ad3-eb3c-44ee-b257-5997de080b7f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029816 May 17 12:17:44.300757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 510/1032] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:17:44.320087 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-22944dab-31be-4d3c-aec2-a4cec47e677f tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708215774" status: 204 len: 0 microversion: 2.20 time: 1.037197 May 17 12:17:44.320783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 523/1033] 10.222.0.58 () {60 vars in 1261 bytes} [Tue May 17 12:17:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708215774 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 17 12:17:44.582574 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:44.583365 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:44.589394 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:44.589856 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:44.590638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:44.591139 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:44.624066 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:44.624543 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:44.624983 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lazy-loading 'fault' on Instance uuid a3b1b152-078a-4044-b489-0ffc4e061fed {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:17:44.671025 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:44.679246 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-bcec6f87-2a49-47d7-a156-f59b599025d2 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 200 len: 1303 microversion: 2.1 time: 0.100908 May 17 12:17:44.680442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 511/1034] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:44 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:45.698328 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1d381ea7-4d93-4725-b141-b1b16f95c9ce tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:45.699254 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1d381ea7-4d93-4725-b141-b1b16f95c9ce tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: a3b1b152-078a-4044-b489-0ffc4e061fed] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:45.707850 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d381ea7-4d93-4725-b141-b1b16f95c9ce tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:45.708645 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d381ea7-4d93-4725-b141-b1b16f95c9ce tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:45.709750 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d381ea7-4d93-4725-b141-b1b16f95c9ce tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:45.710201 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1d381ea7-4d93-4725-b141-b1b16f95c9ce tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:45.723022 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-1d381ea7-4d93-4725-b141-b1b16f95c9ce tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] HTTP exception thrown: Instance a3b1b152-078a-4044-b489-0ffc4e061fed could not be found. May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1d381ea7-4d93-4725-b141-b1b16f95c9ce tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Request method failure captured: May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed HTTP/1.1 May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig5JRhvf-_HHeFI9j5oaNRedwatOgREdKouONZMIYJXFTyPrLJjqy-y3f-GVilZrBOebtFLPdK2fzxIB9QmDzYvuqcM3CF8FAM4hC2cKO0Sw1Q-B5ppeUwkV9Ua6XGu9T1q2FMbX4SPuPtKxbP02IYEKauYtydBsiY7qHY-urPN5Rgdw May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: f55775e2790046029256efb09b501c89 May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-VolumesActionsTest-1761414393 May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:17:45.725221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f55775e2790046029256efb09b501c89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f55775e2790046029256efb09b501c89", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f55775e2790046029256efb09b501c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f55775e2790046029256efb09b501c89"}]}] May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-VolumesActionsTest-1761414393 May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: f55775e2790046029256efb09b501c89 May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-VolumesActionsTest-1761414393 May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-VolumesActionsTest-1761414393-project May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 291b520eed8f446b86296165fb5d658a May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-VolumesActionsTest-1761414393-project May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance a3b1b152-078a-4044-b489-0ffc4e061fed could not be found. May 17 12:17:45.726821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'a3b1b152-078a-4044-b489-0ffc4e061fed'} May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3b1b152-078a-4044-b489-0ffc4e061fed could not be found. May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:45.727773 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3b1b152-078a-4044-b489-0ffc4e061fed could not be found. May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3b1b152-078a-4044-b489-0ffc4e061fed could not be found. May 17 12:17:45.729285 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:45.730833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1d381ea7-4d93-4725-b141-b1b16f95c9ce tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Returning 404 to user: Instance a3b1b152-078a-4044-b489-0ffc4e061fed could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:45.730833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1d381ea7-4d93-4725-b141-b1b16f95c9ce tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed" status: 404 len: 111 microversion: 2.1 time: 0.034356 May 17 12:17:45.730833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 524/1035] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:45 2022] GET /compute/v2.1/servers/a3b1b152-078a-4044-b489-0ffc4e061fed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:17:45.822423 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-479281214", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452", "networks": [{"uuid": "49f3cb23-6bce-4173-805c-bcdc334068cb"}]}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:45.874489 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] validate_networks() for [('49f3cb23-6bce-4173-805c-bcdc334068cb', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:17:46.219266 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:17:46.219701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:17:46.220203 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:17:46.220632 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:17:46.221050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:17:46.230519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:46.230974 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:46.231785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:46.232258 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:46.248984 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Getting quotas for project f55775e2790046029256efb09b501c89. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:17:46.252879 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Getting quotas for user 291b520eed8f446b86296165fb5d658a and project f55775e2790046029256efb09b501c89. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:17:46.270166 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:17:46.272624 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:17:46.317161 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e58b6404-1cd6-40d1-b64d-60ba35e98550 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499859 May 17 12:17:46.317849 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 512/1036] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:17:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:17:46.328219 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fba005f5-382a-4b14-97a9-f0aa5df3a4ef tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:46.328790 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fba005f5-382a-4b14-97a9-f0aa5df3a4ef tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:46.382595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fba005f5-382a-4b14-97a9-f0aa5df3a4ef tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:46.389182 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fba005f5-382a-4b14-97a9-f0aa5df3a4ef tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1213 microversion: 2.1 time: 0.065192 May 17 12:17:46.389755 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 525/1037] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:46 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:47.407271 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-620ec3e8-fea4-4df2-836e-a48af428b25d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:47.407886 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-620ec3e8-fea4-4df2-836e-a48af428b25d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:47.414593 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-620ec3e8-fea4-4df2-836e-a48af428b25d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:47.415042 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-620ec3e8-fea4-4df2-836e-a48af428b25d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:47.415812 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-620ec3e8-fea4-4df2-836e-a48af428b25d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:47.416280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-620ec3e8-fea4-4df2-836e-a48af428b25d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:47.476946 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-620ec3e8-fea4-4df2-836e-a48af428b25d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:47.484145 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-620ec3e8-fea4-4df2-836e-a48af428b25d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1217 microversion: 2.1 time: 0.081257 May 17 12:17:47.484739 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 513/1038] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:47 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:48.500978 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-15b65575-d1fd-49d2-9f87-1b1421d8906e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:48.501597 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-15b65575-d1fd-49d2-9f87-1b1421d8906e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:48.508926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-15b65575-d1fd-49d2-9f87-1b1421d8906e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:48.509391 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-15b65575-d1fd-49d2-9f87-1b1421d8906e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:48.510158 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-15b65575-d1fd-49d2-9f87-1b1421d8906e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:48.510599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-15b65575-d1fd-49d2-9f87-1b1421d8906e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:48.573951 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-15b65575-d1fd-49d2-9f87-1b1421d8906e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:48.581570 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-15b65575-d1fd-49d2-9f87-1b1421d8906e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1209 microversion: 2.1 time: 0.084385 May 17 12:17:48.582118 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 526/1039] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:48 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:49.598041 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3f549666-a5a7-4fa9-a3f4-10043c940eb1 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:49.598586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-3f549666-a5a7-4fa9-a3f4-10043c940eb1 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:49.605230 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3f549666-a5a7-4fa9-a3f4-10043c940eb1 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:49.605677 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3f549666-a5a7-4fa9-a3f4-10043c940eb1 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:49.606451 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3f549666-a5a7-4fa9-a3f4-10043c940eb1 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:49.606887 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3f549666-a5a7-4fa9-a3f4-10043c940eb1 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:49.667707 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-3f549666-a5a7-4fa9-a3f4-10043c940eb1 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:49.675097 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-3f549666-a5a7-4fa9-a3f4-10043c940eb1 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1265 microversion: 2.1 time: 0.081074 May 17 12:17:49.675670 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 514/1040] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:49 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:50.286330 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9f1b3729-b451-4962-a25b-5b5df1dba748 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:50.287042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-9f1b3729-b451-4962-a25b-5b5df1dba748 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:50.293714 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f1b3729-b451-4962-a25b-5b5df1dba748 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:50.294165 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f1b3729-b451-4962-a25b-5b5df1dba748 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:50.294923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f1b3729-b451-4962-a25b-5b5df1dba748 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:50.295363 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-9f1b3729-b451-4962-a25b-5b5df1dba748 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:50.309419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-9f1b3729-b451-4962-a25b-5b5df1dba748 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] HTTP exception thrown: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9f1b3729-b451-4962-a25b-5b5df1dba748 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Request method failure captured: May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: DELETE /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 HTTP/1.1 May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_FF35wQCZYa_5R-rm3Al3m8tWE9gPaJAlaRYwQysw1zVZ7iCL1vxXAIpNoKJNNnbSpnGIY0GzbErBufU2yEqLY4BfaskjzAmlvB1bh0uEmgObKIWJAwOb309IlBfJOkqvbDK3B4uJlykOhrz-elL5Fyau25rG-hk7aqNaKhjSSEzs May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Openstack-Nova-Api-Version: 2.20 May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:17:50.311020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cd2c9994923540748c1513406e3e7ffc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}] May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: e8a6a76a94ca4fb197c7b1705b809c54 May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:50.312454 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23'} May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:50.313187 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:50.314353 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:50.315538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-9f1b3729-b451-4962-a25b-5b5df1dba748 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Returning 404 to user: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:50.315538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-9f1b3729-b451-4962-a25b-5b5df1dba748 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 404 len: 111 microversion: 2.20 time: 0.030094 May 17 12:17:50.315538 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 527/1041] 10.222.0.58 () {60 vars in 1279 bytes} [Tue May 17 12:17:50 2022] DELETE /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 12:17:50.321356 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-881f1900-5bd5-442c-b5e3-6ff592dd2ed9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:50.321972 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-881f1900-5bd5-442c-b5e3-6ff592dd2ed9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:50.328100 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-881f1900-5bd5-442c-b5e3-6ff592dd2ed9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:50.328586 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-881f1900-5bd5-442c-b5e3-6ff592dd2ed9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:50.329354 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-881f1900-5bd5-442c-b5e3-6ff592dd2ed9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:50.329790 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-881f1900-5bd5-442c-b5e3-6ff592dd2ed9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:50.343188 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-881f1900-5bd5-442c-b5e3-6ff592dd2ed9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] HTTP exception thrown: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-881f1900-5bd5-442c-b5e3-6ff592dd2ed9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Request method failure captured: May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 HTTP/1.1 May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_FF35wQCZYa_5R-rm3Al3m8tWE9gPaJAlaRYwQysw1zVZ7iCL1vxXAIpNoKJNNnbSpnGIY0GzbErBufU2yEqLY4BfaskjzAmlvB1bh0uEmgObKIWJAwOb309IlBfJOkqvbDK3B4uJlykOhrz-elL5Fyau25rG-hk7aqNaKhjSSEzs May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Openstack-Nova-Api-Version: 2.20 May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:17:50.344904 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cd2c9994923540748c1513406e3e7ffc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}] May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: e8a6a76a94ca4fb197c7b1705b809c54 May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:50.346528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23'} May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:50.347450 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. May 17 12:17:50.349197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:50.350598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-881f1900-5bd5-442c-b5e3-6ff592dd2ed9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Returning 404 to user: Instance b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:50.350598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-881f1900-5bd5-442c-b5e3-6ff592dd2ed9 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23" status: 404 len: 111 microversion: 2.20 time: 0.029315 May 17 12:17:50.352500 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 515/1042] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:50 2022] GET /compute/v2.1/servers/b8bb9c6c-fc0f-48c7-83b6-a1937e4a2f23 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 12:17:50.692336 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-38cae53f-fc24-4f6c-9a67-e6bf19120599 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:50.694106 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-38cae53f-fc24-4f6c-9a67-e6bf19120599 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:50.700289 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38cae53f-fc24-4f6c-9a67-e6bf19120599 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:50.700753 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38cae53f-fc24-4f6c-9a67-e6bf19120599 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:50.701548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38cae53f-fc24-4f6c-9a67-e6bf19120599 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:50.701977 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-38cae53f-fc24-4f6c-9a67-e6bf19120599 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:50.905664 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-38cae53f-fc24-4f6c-9a67-e6bf19120599 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:50.913010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-38cae53f-fc24-4f6c-9a67-e6bf19120599 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.224653 May 17 12:17:50.913585 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 528/1043] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:50 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:51.365154 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-b10edce1-7339-4c31-86a6-c27c1b6cde94 req-af547062-685d-44b4-bda6-66095ff4fc7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25174089-91e4-4824-b85a-7778730e3289", "tag": "6cd6a140-eca6-45f8-9b0a-aee99632e238"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:51.373564 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-b10edce1-7339-4c31-86a6-c27c1b6cde94 req-af547062-685d-44b4-bda6-66095ff4fc7f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:51.374012 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-b10edce1-7339-4c31-86a6-c27c1b6cde94 req-af547062-685d-44b4-bda6-66095ff4fc7f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:51.385863 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-b10edce1-7339-4c31-86a6-c27c1b6cde94 req-af547062-685d-44b4-bda6-66095ff4fc7f service nova] Creating event network-changed:6cd6a140-eca6-45f8-9b0a-aee99632e238 for instance 25174089-91e4-4824-b85a-7778730e3289 on hv-cinder-83769 May 17 12:17:51.390916 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-b10edce1-7339-4c31-86a6-c27c1b6cde94 req-af547062-685d-44b4-bda6-66095ff4fc7f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161905 May 17 12:17:51.391530 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 516/1044] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:17:51.483503 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-eb3810d3-b62c-498b-80ae-af02bc576558 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:51.484946 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-eb3810d3-b62c-498b-80ae-af02bc576558 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:51.491888 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb3810d3-b62c-498b-80ae-af02bc576558 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:51.492393 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb3810d3-b62c-498b-80ae-af02bc576558 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:51.493171 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb3810d3-b62c-498b-80ae-af02bc576558 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:51.493601 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-eb3810d3-b62c-498b-80ae-af02bc576558 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:51.506704 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-eb3810d3-b62c-498b-80ae-af02bc576558 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] HTTP exception thrown: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-eb3810d3-b62c-498b-80ae-af02bc576558 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Request method failure captured: May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: DELETE /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 HTTP/1.1 May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig4_FF35wQCZYa_5R-rm3Al3m8tWE9gPaJAlaRYwQysw1zVZ7iCL1vxXAIpNoKJNNnbSpnGIY0GzbErBufU2yEqLY4BfaskjzAmlvB1bh0uEmgObKIWJAwOb309IlBfJOkqvbDK3B4uJlykOhrz-elL5Fyau25rG-hk7aqNaKhjSSEzs May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Openstack-Nova-Api-Version: 2.20 May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:17:51.508278 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cd2c9994923540748c1513406e3e7ffc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}] May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: e8a6a76a94ca4fb197c7b1705b809c54 May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:17:51.509905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'd883f923-082e-4ee1-ba3e-0975ba2d7409'} May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:51.510923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:17:51.512130 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:51.513492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-eb3810d3-b62c-498b-80ae-af02bc576558 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Returning 404 to user: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:51.513492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-eb3810d3-b62c-498b-80ae-af02bc576558 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 404 len: 111 microversion: 2.20 time: 0.030250 May 17 12:17:51.513492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 529/1045] 10.222.0.58 () {60 vars in 1279 bytes} [Tue May 17 12:17:51 2022] DELETE /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 12:17:51.519335 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0d1b039d-4f83-40a7-9f18-0e1cb302b4b4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:51.520038 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0d1b039d-4f83-40a7-9f18-0e1cb302b4b4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] [instance: d883f923-082e-4ee1-ba3e-0975ba2d7409] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:51.526593 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0d1b039d-4f83-40a7-9f18-0e1cb302b4b4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:51.527050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0d1b039d-4f83-40a7-9f18-0e1cb302b4b4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:51.527840 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0d1b039d-4f83-40a7-9f18-0e1cb302b4b4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:51.528367 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0d1b039d-4f83-40a7-9f18-0e1cb302b4b4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:51.542664 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-0d1b039d-4f83-40a7-9f18-0e1cb302b4b4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] HTTP exception thrown: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0d1b039d-4f83-40a7-9f18-0e1cb302b4b4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Request method failure captured: May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 HTTP/1.1 May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig4_FF35wQCZYa_5R-rm3Al3m8tWE9gPaJAlaRYwQysw1zVZ7iCL1vxXAIpNoKJNNnbSpnGIY0GzbErBufU2yEqLY4BfaskjzAmlvB1bh0uEmgObKIWJAwOb309IlBfJOkqvbDK3B4uJlykOhrz-elL5Fyau25rG-hk7aqNaKhjSSEzs May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Openstack-Nova-Api-Version: 2.20 May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:17:51.544448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cd2c9994923540748c1513406e3e7ffc", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cd2c9994923540748c1513406e3e7ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cd2c9994923540748c1513406e3e7ffc"}]}] May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: cd2c9994923540748c1513406e3e7ffc May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-142170603 May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: e8a6a76a94ca4fb197c7b1705b809c54 May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-AttachVolumeShelveTestJSON-142170603-project May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:17:51.546102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'd883f923-082e-4ee1-ba3e-0975ba2d7409'} May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:51.546935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. May 17 12:17:51.548242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:17:51.549588 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0d1b039d-4f83-40a7-9f18-0e1cb302b4b4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] Returning 404 to user: Instance d883f923-082e-4ee1-ba3e-0975ba2d7409 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:51.549588 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0d1b039d-4f83-40a7-9f18-0e1cb302b4b4 tempest-AttachVolumeShelveTestJSON-142170603 tempest-AttachVolumeShelveTestJSON-142170603-project] 10.222.0.58 "GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409" status: 404 len: 111 microversion: 2.20 time: 0.030706 May 17 12:17:51.549588 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 517/1046] 10.222.0.58 () {60 vars in 1276 bytes} [Tue May 17 12:17:51 2022] GET /compute/v2.1/servers/d883f923-082e-4ee1-ba3e-0975ba2d7409 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 12:17:51.930212 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1c921f96-b572-44d1-a8cc-474806627419 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:51.930839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1c921f96-b572-44d1-a8cc-474806627419 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:51.936607 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c921f96-b572-44d1-a8cc-474806627419 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:51.937065 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c921f96-b572-44d1-a8cc-474806627419 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:51.937836 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c921f96-b572-44d1-a8cc-474806627419 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:51.938302 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1c921f96-b572-44d1-a8cc-474806627419 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:52.071020 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1c921f96-b572-44d1-a8cc-474806627419 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:52.079263 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1c921f96-b572-44d1-a8cc-474806627419 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.153009 May 17 12:17:52.079828 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 530/1047] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:51 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:53.097449 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-eade0938-46f6-4afe-93f4-819e8ee54c67 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:53.098047 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-eade0938-46f6-4afe-93f4-819e8ee54c67 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:53.104888 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eade0938-46f6-4afe-93f4-819e8ee54c67 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:53.105332 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eade0938-46f6-4afe-93f4-819e8ee54c67 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:53.106109 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eade0938-46f6-4afe-93f4-819e8ee54c67 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:53.106670 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-eade0938-46f6-4afe-93f4-819e8ee54c67 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:53.315779 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-eade0938-46f6-4afe-93f4-819e8ee54c67 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:53.324025 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-eade0938-46f6-4afe-93f4-819e8ee54c67 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.230624 May 17 12:17:53.324701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 518/1048] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:53 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:54.342731 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a806ad49-0c72-4d9d-b0a0-9a07394691a4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:54.344101 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a806ad49-0c72-4d9d-b0a0-9a07394691a4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:54.356046 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a806ad49-0c72-4d9d-b0a0-9a07394691a4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:54.357009 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a806ad49-0c72-4d9d-b0a0-9a07394691a4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:54.357979 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a806ad49-0c72-4d9d-b0a0-9a07394691a4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:54.358604 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a806ad49-0c72-4d9d-b0a0-9a07394691a4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:54.602417 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a806ad49-0c72-4d9d-b0a0-9a07394691a4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:54.610470 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a806ad49-0c72-4d9d-b0a0-9a07394691a4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.272793 May 17 12:17:54.611042 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 531/1049] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:54 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:55.626621 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-68a76baa-595b-42fd-9c72-caf1d275ce6d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:55.627242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-68a76baa-595b-42fd-9c72-caf1d275ce6d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:55.633784 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-68a76baa-595b-42fd-9c72-caf1d275ce6d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:55.634242 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-68a76baa-595b-42fd-9c72-caf1d275ce6d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:55.635015 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-68a76baa-595b-42fd-9c72-caf1d275ce6d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:55.635455 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-68a76baa-595b-42fd-9c72-caf1d275ce6d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:55.762696 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-d6876d14-451e-44f9-94bc-21333671067b tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] Action: 'create', calling method: .version_select at 0x7f2db419ddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1492228257", "metadata": {"Type": "work"}}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:17:55.772725 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-68a76baa-595b-42fd-9c72-caf1d275ce6d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:55.780332 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-68a76baa-595b-42fd-9c72-caf1d275ce6d tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.157468 May 17 12:17:55.780966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 519/1050] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:55 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:56.035221 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-d6876d14-451e-44f9-94bc-21333671067b tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.386141 May 17 12:17:56.035855 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 532/1051] 10.222.0.58 () {60 vars in 1155 bytes} [Tue May 17 12:17:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 388 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 17 12:17:56.046828 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-455a6895-f9a6-4703-8a6f-af84b6258d9f tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] Calling method '.version_select at 0x7f2db43eb280>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:56.096294 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-455a6895-f9a6-4703-8a6f-af84b6258d9f tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8" status: 200 len: 353 microversion: 2.1 time: 0.053179 May 17 12:17:56.096883 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 520/1052] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:17:56 2022] GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:17:56.797961 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b10142b7-4bff-4080-92a5-a794652879f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:56.798520 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b10142b7-4bff-4080-92a5-a794652879f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:56.806150 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b10142b7-4bff-4080-92a5-a794652879f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:56.806602 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b10142b7-4bff-4080-92a5-a794652879f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:56.807371 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b10142b7-4bff-4080-92a5-a794652879f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:56.807806 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b10142b7-4bff-4080-92a5-a794652879f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:56.934953 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b10142b7-4bff-4080-92a5-a794652879f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:56.942197 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b10142b7-4bff-4080-92a5-a794652879f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.148677 May 17 12:17:56.942752 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 533/1053] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:56 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:57.109627 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-29187305-6df0-4630-822a-b2318a7be475 tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] Calling method '.version_select at 0x7f2db4219a60>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:57.154529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-29187305-6df0-4630-822a-b2318a7be475 tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8" status: 200 len: 353 microversion: 2.1 time: 0.049247 May 17 12:17:57.155151 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 521/1054] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:17:57 2022] GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:17:57.959444 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-728d74ea-9004-4d29-8a43-c5f7761f3fee tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:57.961190 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-728d74ea-9004-4d29-8a43-c5f7761f3fee tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:57.968818 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-728d74ea-9004-4d29-8a43-c5f7761f3fee tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:57.969260 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-728d74ea-9004-4d29-8a43-c5f7761f3fee tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:57.970107 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-728d74ea-9004-4d29-8a43-c5f7761f3fee tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:57.970544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-728d74ea-9004-4d29-8a43-c5f7761f3fee tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:58.167912 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c67a3efd-ad6c-4c22-8264-3fc3d10eb89b tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] Calling method '.version_select at 0x7f2db444b790>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:58.198289 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-728d74ea-9004-4d29-8a43-c5f7761f3fee tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:58.206293 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-728d74ea-9004-4d29-8a43-c5f7761f3fee tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.251294 May 17 12:17:58.207134 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 534/1055] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:57 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:58.225773 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c67a3efd-ad6c-4c22-8264-3fc3d10eb89b tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8" status: 200 len: 354 microversion: 2.1 time: 0.062138 May 17 12:17:58.226424 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 522/1056] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:17:58 2022] GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:17:58.237024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-539aea74-5d84-4f2b-a6ef-5ac8bef4f58b tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] Calling method '.version_select at 0x7f2db415eb80>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:58.283031 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-539aea74-5d84-4f2b-a6ef-5ac8bef4f58b tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8" status: 200 len: 354 microversion: 2.1 time: 0.049690 May 17 12:17:58.283629 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 535/1057] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:17:58 2022] GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:17:58.299488 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d6c78cef-97ba-4e14-a9cd-7c4e2a504775 tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] Calling method '.version_select at 0x7f2db4339940>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:58.379126 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d6c78cef-97ba-4e14-a9cd-7c4e2a504775 tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8" status: 202 len: 0 microversion: 2.1 time: 0.083084 May 17 12:17:58.383940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 523/1058] 10.222.0.58 () {58 vars in 1247 bytes} [Tue May 17 12:17:58 2022] DELETE /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:17:58.388489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4a1c35e9-b0c7-474c-8a59-06888e641383 tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] Calling method '.version_select at 0x7f2db4280dc0>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:58.441150 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4a1c35e9-b0c7-474c-8a59-06888e641383 tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8" status: 200 len: 353 microversion: 2.1 time: 0.056434 May 17 12:17:58.441749 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 536/1059] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:17:58 2022] GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:17:59.224319 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-05115e9d-3bfb-4db6-853a-a5770f0c4af9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:59.224932 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-05115e9d-3bfb-4db6-853a-a5770f0c4af9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:17:59.231115 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-05115e9d-3bfb-4db6-853a-a5770f0c4af9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:59.231566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-05115e9d-3bfb-4db6-853a-a5770f0c4af9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:59.232425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-05115e9d-3bfb-4db6-853a-a5770f0c4af9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:17:59.232842 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-05115e9d-3bfb-4db6-853a-a5770f0c4af9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:17:59.357576 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-05115e9d-3bfb-4db6-853a-a5770f0c4af9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:17:59.364854 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-05115e9d-3bfb-4db6-853a-a5770f0c4af9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.144854 May 17 12:17:59.365430 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 524/1060] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:17:59 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:17:59.454195 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4be4ca61-84c7-4e6c-adee-d02d56e5e80a tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] Calling method '.version_select at 0x7f2db419d040>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:17:59.480856 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-4be4ca61-84c7-4e6c-adee-d02d56e5e80a tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] HTTP exception thrown: Volume 74ab025f-f5b3-45e7-a141-74bd20ddd6d8 could not be found. May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4be4ca61-84c7-4e6c-adee-d02d56e5e80a tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] Request method failure captured: May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8 HTTP/1.1 May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig5Jz3Xv28es_VscWgtC_iPp0DDxP4sHrTWU30HlTRov27yEuGcXAkak-gc9DV9Hfn5ujyBVUSXIKPKRfNzsbcp-XGkSefsVMPF9ysfc5vJM6BGkjXW6xXU5Y7k8OoLdXXRe-FmYQRHR0F9SgWWSLGVByZn-1yGihXFLX_ui2YIMTtfk May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 433189fb223e42cc951a2e49ab594b5e May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-VolumesGetTestJSON-819761976 May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:17:59.482832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/433189fb223e42cc951a2e49ab594b5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_433189fb223e42cc951a2e49ab594b5e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/433189fb223e42cc951a2e49ab594b5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/433189fb223e42cc951a2e49ab594b5e"}]}] May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-VolumesGetTestJSON-819761976 May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 433189fb223e42cc951a2e49ab594b5e May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-VolumesGetTestJSON-819761976 May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-VolumesGetTestJSON-819761976-project May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: df177150e583426995918e85411af4bb May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-VolumesGetTestJSON-819761976-project May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Volume 74ab025f-f5b3-45e7-a141-74bd20ddd6d8 could not be found. May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '74ab025f-f5b3-45e7-a141-74bd20ddd6d8'} May 17 12:17:59.484410 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74ab025f-f5b3-45e7-a141-74bd20ddd6d8 could not be found. (HTTP 404) (Request-ID: req-9b79e4c4-2354-4fc4-b200-2c0fb3c1580f) May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:59.485528 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 12:17:59.486926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74ab025f-f5b3-45e7-a141-74bd20ddd6d8 could not be found. May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 12:17:59.488385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74ab025f-f5b3-45e7-a141-74bd20ddd6d8 could not be found. May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74ab025f-f5b3-45e7-a141-74bd20ddd6d8 could not be found. May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4be4ca61-84c7-4e6c-adee-d02d56e5e80a tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] Returning 404 to user: Volume 74ab025f-f5b3-45e7-a141-74bd20ddd6d8 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4be4ca61-84c7-4e6c-adee-d02d56e5e80a tempest-VolumesGetTestJSON-819761976 tempest-VolumesGetTestJSON-819761976-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8" status: 404 len: 109 microversion: 2.1 time: 0.034579 May 17 12:17:59.489754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 537/1061] 10.222.0.58 () {58 vars in 1244 bytes} [Tue May 17 12:17:59 2022] GET /compute/v2.1/os-volumes/74ab025f-f5b3-45e7-a141-74bd20ddd6d8 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:18:00.382665 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-df6474da-f4bd-429f-b52d-733b222046f4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:00.383360 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-df6474da-f4bd-429f-b52d-733b222046f4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:00.389588 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-df6474da-f4bd-429f-b52d-733b222046f4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:00.390035 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-df6474da-f4bd-429f-b52d-733b222046f4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:00.390830 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-df6474da-f4bd-429f-b52d-733b222046f4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:00.391267 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-df6474da-f4bd-429f-b52d-733b222046f4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:00.530190 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-df6474da-f4bd-429f-b52d-733b222046f4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:00.538724 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-df6474da-f4bd-429f-b52d-733b222046f4 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.160430 May 17 12:18:00.539489 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 525/1062] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:00 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:01.555316 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4e5a392e-21f9-4653-b36a-36c20e8113f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:01.555936 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4e5a392e-21f9-4653-b36a-36c20e8113f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:01.561958 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4e5a392e-21f9-4653-b36a-36c20e8113f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:01.562409 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4e5a392e-21f9-4653-b36a-36c20e8113f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:01.563185 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4e5a392e-21f9-4653-b36a-36c20e8113f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:01.563625 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4e5a392e-21f9-4653-b36a-36c20e8113f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:01.690065 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4e5a392e-21f9-4653-b36a-36c20e8113f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:01.697548 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4e5a392e-21f9-4653-b36a-36c20e8113f0 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.146678 May 17 12:18:01.698109 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 538/1063] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:01 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:02.713815 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-98c31899-121c-4718-8ad2-ff685a183f04 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:02.714473 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-98c31899-121c-4718-8ad2-ff685a183f04 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:02.720903 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98c31899-121c-4718-8ad2-ff685a183f04 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:02.721359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98c31899-121c-4718-8ad2-ff685a183f04 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:02.722134 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98c31899-121c-4718-8ad2-ff685a183f04 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:02.722579 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-98c31899-121c-4718-8ad2-ff685a183f04 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:02.849656 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-98c31899-121c-4718-8ad2-ff685a183f04 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:02.857431 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-98c31899-121c-4718-8ad2-ff685a183f04 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.147559 May 17 12:18:02.858004 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 526/1064] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:02 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:03.873509 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7f8c7851-16a6-4094-a1bd-b5d18c4d61f9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:03.874159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7f8c7851-16a6-4094-a1bd-b5d18c4d61f9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:03.880436 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7f8c7851-16a6-4094-a1bd-b5d18c4d61f9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:03.880889 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7f8c7851-16a6-4094-a1bd-b5d18c4d61f9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:03.882231 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7f8c7851-16a6-4094-a1bd-b5d18c4d61f9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:03.882667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7f8c7851-16a6-4094-a1bd-b5d18c4d61f9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:04.049553 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7f8c7851-16a6-4094-a1bd-b5d18c4d61f9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:04.058600 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7f8c7851-16a6-4094-a1bd-b5d18c4d61f9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.188898 May 17 12:18:04.059148 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 539/1065] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:03 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:04.727848 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-16b74313-c5d0-41db-90d9-64ab67e54560 req-d0d65f00-8b5c-4cb9-9f6f-98bff3aa9944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25174089-91e4-4824-b85a-7778730e3289", "name": "network-vif-plugged", "status": "completed", "tag": "6cd6a140-eca6-45f8-9b0a-aee99632e238"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:18:04.736535 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-16b74313-c5d0-41db-90d9-64ab67e54560 req-d0d65f00-8b5c-4cb9-9f6f-98bff3aa9944 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:04.736913 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-16b74313-c5d0-41db-90d9-64ab67e54560 req-d0d65f00-8b5c-4cb9-9f6f-98bff3aa9944 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:04.748564 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-16b74313-c5d0-41db-90d9-64ab67e54560 req-d0d65f00-8b5c-4cb9-9f6f-98bff3aa9944 service nova] Creating event network-vif-plugged:6cd6a140-eca6-45f8-9b0a-aee99632e238 for instance 25174089-91e4-4824-b85a-7778730e3289 on hv-cinder-83769 May 17 12:18:04.753724 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-16b74313-c5d0-41db-90d9-64ab67e54560 req-d0d65f00-8b5c-4cb9-9f6f-98bff3aa9944 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221164 May 17 12:18:04.754418 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 527/1066] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:18:05.075807 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-fbb68e9e-0dbe-4585-a834-1bc00b9398ab tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:05.076505 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-fbb68e9e-0dbe-4585-a834-1bc00b9398ab tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:05.083205 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fbb68e9e-0dbe-4585-a834-1bc00b9398ab tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:05.083657 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fbb68e9e-0dbe-4585-a834-1bc00b9398ab tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:05.084816 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fbb68e9e-0dbe-4585-a834-1bc00b9398ab tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:05.085328 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-fbb68e9e-0dbe-4585-a834-1bc00b9398ab tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:05.219037 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-fbb68e9e-0dbe-4585-a834-1bc00b9398ab tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:05.227302 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-fbb68e9e-0dbe-4585-a834-1bc00b9398ab tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.155445 May 17 12:18:05.227913 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 540/1067] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:05 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:06.246099 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-83e917f7-a6d2-4ffc-b94c-41e51ca3d231 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:06.246793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-83e917f7-a6d2-4ffc-b94c-41e51ca3d231 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:06.252907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-83e917f7-a6d2-4ffc-b94c-41e51ca3d231 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:06.253390 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-83e917f7-a6d2-4ffc-b94c-41e51ca3d231 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:06.254252 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-83e917f7-a6d2-4ffc-b94c-41e51ca3d231 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:06.254726 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-83e917f7-a6d2-4ffc-b94c-41e51ca3d231 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:06.386464 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-83e917f7-a6d2-4ffc-b94c-41e51ca3d231 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:06.395380 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-83e917f7-a6d2-4ffc-b94c-41e51ca3d231 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1313 microversion: 2.1 time: 0.153740 May 17 12:18:06.396145 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 528/1068] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:06 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:07.412062 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-df0ae8fe-1008-49f2-a02e-69bdfede2c58 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:07.412825 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-df0ae8fe-1008-49f2-a02e-69bdfede2c58 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:07.419679 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-df0ae8fe-1008-49f2-a02e-69bdfede2c58 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:07.420241 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-df0ae8fe-1008-49f2-a02e-69bdfede2c58 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:07.421131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-df0ae8fe-1008-49f2-a02e-69bdfede2c58 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:07.421662 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-df0ae8fe-1008-49f2-a02e-69bdfede2c58 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:07.571005 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-df0ae8fe-1008-49f2-a02e-69bdfede2c58 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:07.579527 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-df0ae8fe-1008-49f2-a02e-69bdfede2c58 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1497 microversion: 2.1 time: 0.171407 May 17 12:18:07.580113 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 541/1069] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:07 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:08.603902 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-9dcb87b9-180d-401d-b745-c403c99880ff tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:08.604689 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9dcb87b9-180d-401d-b745-c403c99880ff tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:08.610614 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9dcb87b9-180d-401d-b745-c403c99880ff tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:08.611069 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9dcb87b9-180d-401d-b745-c403c99880ff tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:08.611896 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9dcb87b9-180d-401d-b745-c403c99880ff tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:08.612386 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-9dcb87b9-180d-401d-b745-c403c99880ff tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:08.638055 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-9dcb87b9-180d-401d-b745-c403c99880ff tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Going to try to terminate instance {{(pid=117113) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:18:08.720886 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-9dcb87b9-180d-401d-b745-c403c99880ff tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "DELETE /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 204 len: 0 microversion: 2.1 time: 0.120435 May 17 12:18:08.721690 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 529/1070] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:18:08 2022] DELETE /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:18:08.731754 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-84a95653-e388-4877-a2d1-125cad67c335 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:08.732426 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-84a95653-e388-4877-a2d1-125cad67c335 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:08.739296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-84a95653-e388-4877-a2d1-125cad67c335 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:08.740013 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-84a95653-e388-4877-a2d1-125cad67c335 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:08.740900 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-84a95653-e388-4877-a2d1-125cad67c335 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:08.741524 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-84a95653-e388-4877-a2d1-125cad67c335 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:08.874758 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-84a95653-e388-4877-a2d1-125cad67c335 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:08.882157 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-84a95653-e388-4877-a2d1-125cad67c335 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1503 microversion: 2.1 time: 0.156111 May 17 12:18:08.882721 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 542/1071] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:08 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:18:09.899823 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a48b4598-0047-441d-af95-320dfcaa8795 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:09.900576 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a48b4598-0047-441d-af95-320dfcaa8795 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:09.907303 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a48b4598-0047-441d-af95-320dfcaa8795 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:09.907758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a48b4598-0047-441d-af95-320dfcaa8795 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:09.908659 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a48b4598-0047-441d-af95-320dfcaa8795 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:09.909109 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a48b4598-0047-441d-af95-320dfcaa8795 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:10.079603 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a48b4598-0047-441d-af95-320dfcaa8795 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:10.087261 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a48b4598-0047-441d-af95-320dfcaa8795 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1503 microversion: 2.1 time: 0.192026 May 17 12:18:10.087833 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 530/1072] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:09 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:11.104572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-29a54241-36c0-4e81-8dd3-6b16722299a9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:11.105140 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-29a54241-36c0-4e81-8dd3-6b16722299a9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:11.111608 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-29a54241-36c0-4e81-8dd3-6b16722299a9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:11.112053 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-29a54241-36c0-4e81-8dd3-6b16722299a9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:11.112846 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-29a54241-36c0-4e81-8dd3-6b16722299a9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:11.113281 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-29a54241-36c0-4e81-8dd3-6b16722299a9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:11.244989 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-29a54241-36c0-4e81-8dd3-6b16722299a9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:11.252698 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-29a54241-36c0-4e81-8dd3-6b16722299a9 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1503 microversion: 2.1 time: 0.152014 May 17 12:18:11.253282 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 543/1073] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:11 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:12.270127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a8056243-5cf1-4d09-b61b-09ba9f678438 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:12.270836 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a8056243-5cf1-4d09-b61b-09ba9f678438 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:12.277966 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a8056243-5cf1-4d09-b61b-09ba9f678438 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:12.278425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a8056243-5cf1-4d09-b61b-09ba9f678438 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:12.279200 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a8056243-5cf1-4d09-b61b-09ba9f678438 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:12.279643 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a8056243-5cf1-4d09-b61b-09ba9f678438 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:12.412122 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a8056243-5cf1-4d09-b61b-09ba9f678438 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:12.420352 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a8056243-5cf1-4d09-b61b-09ba9f678438 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1503 microversion: 2.1 time: 0.154210 May 17 12:18:12.420933 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 531/1074] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:12 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:13.438237 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ee8223ff-66cb-4804-9054-570bf20a1a84 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:13.438905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ee8223ff-66cb-4804-9054-570bf20a1a84 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:13.448490 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ee8223ff-66cb-4804-9054-570bf20a1a84 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:13.448944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ee8223ff-66cb-4804-9054-570bf20a1a84 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:13.449715 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ee8223ff-66cb-4804-9054-570bf20a1a84 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:13.450403 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ee8223ff-66cb-4804-9054-570bf20a1a84 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:13.582618 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-ee8223ff-66cb-4804-9054-570bf20a1a84 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:13.596812 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ee8223ff-66cb-4804-9054-570bf20a1a84 tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1503 microversion: 2.1 time: 0.162530 May 17 12:18:13.597400 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 544/1075] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:13 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:14.208694 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-97666293-d173-4c24-bab0-a7731a58668b req-9dd5bba9-f3cb-4224-8d2e-7c39c7528a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25174089-91e4-4824-b85a-7778730e3289", "name": "network-vif-deleted", "tag": "6cd6a140-eca6-45f8-9b0a-aee99632e238"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:18:14.221046 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-97666293-d173-4c24-bab0-a7731a58668b req-9dd5bba9-f3cb-4224-8d2e-7c39c7528a5a service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:14.221874 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-97666293-d173-4c24-bab0-a7731a58668b req-9dd5bba9-f3cb-4224-8d2e-7c39c7528a5a service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:14.234867 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-97666293-d173-4c24-bab0-a7731a58668b req-9dd5bba9-f3cb-4224-8d2e-7c39c7528a5a service nova] Creating event network-vif-deleted:6cd6a140-eca6-45f8-9b0a-aee99632e238 for instance 25174089-91e4-4824-b85a-7778730e3289 on hv-cinder-83769 May 17 12:18:14.240102 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-97666293-d173-4c24-bab0-a7731a58668b req-9dd5bba9-f3cb-4224-8d2e-7c39c7528a5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039749 May 17 12:18:14.243919 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 532/1076] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:18:14.613960 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:14.614504 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:14.621678 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:14.622191 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:14.623085 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:14.623584 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:14.655976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:14.656455 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:14.656901 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.objects.instance [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lazy-loading 'fault' on Instance uuid 25174089-91e4-4824-b85a-7778730e3289 {{(pid=117114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:18:14.698863 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '291b520eed8f446b86296165fb5d658a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55775e2790046029256efb09b501c89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:18:14.707558 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2eca14bc-7f27-4f50-8f37-0c99f801dc1e tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 200 len: 1303 microversion: 2.1 time: 0.097483 May 17 12:18:14.708199 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 545/1077] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:14 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:18:15.725940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d41ee5aa-4507-4017-88ca-b53eaf3c7b3a tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:15.726785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d41ee5aa-4507-4017-88ca-b53eaf3c7b3a tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] [instance: 25174089-91e4-4824-b85a-7778730e3289] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:15.734716 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d41ee5aa-4507-4017-88ca-b53eaf3c7b3a tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:15.735269 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d41ee5aa-4507-4017-88ca-b53eaf3c7b3a tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:15.736219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d41ee5aa-4507-4017-88ca-b53eaf3c7b3a tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:15.736782 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d41ee5aa-4507-4017-88ca-b53eaf3c7b3a tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:15.751706 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-d41ee5aa-4507-4017-88ca-b53eaf3c7b3a tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] HTTP exception thrown: Instance 25174089-91e4-4824-b85a-7778730e3289 could not be found. May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d41ee5aa-4507-4017-88ca-b53eaf3c7b3a tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Request method failure captured: May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 HTTP/1.1 May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig5JRhvf-_HHeFI9j5oaNRedwatOgREdKouONZMIYJXFTyPrLJjqy-y3f-GVilZrBOebtFLPdK2fzxIB9QmDzYvuqcM3CF8FAM4hC2cKO0Sw1Q-B5ppeUwkV9Ua6XGu9T1q2FMbX4SPuPtKxbP02IYEKauYtydBsiY7qHY-urPN5Rgdw May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: f55775e2790046029256efb09b501c89 May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-VolumesActionsTest-1761414393 May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:18:15.753369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f55775e2790046029256efb09b501c89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f55775e2790046029256efb09b501c89", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f55775e2790046029256efb09b501c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f55775e2790046029256efb09b501c89"}]}] May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-VolumesActionsTest-1761414393 May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: f55775e2790046029256efb09b501c89 May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-VolumesActionsTest-1761414393 May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-VolumesActionsTest-1761414393-project May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 291b520eed8f446b86296165fb5d658a May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-VolumesActionsTest-1761414393-project May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 25174089-91e4-4824-b85a-7778730e3289 could not be found. May 17 12:18:15.755045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '25174089-91e4-4824-b85a-7778730e3289'} May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25174089-91e4-4824-b85a-7778730e3289 could not be found. May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:18:15.756701 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25174089-91e4-4824-b85a-7778730e3289 could not be found. May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25174089-91e4-4824-b85a-7778730e3289 could not be found. May 17 12:18:15.758256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:18:15.759546 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d41ee5aa-4507-4017-88ca-b53eaf3c7b3a tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] Returning 404 to user: Instance 25174089-91e4-4824-b85a-7778730e3289 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:18:15.759546 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d41ee5aa-4507-4017-88ca-b53eaf3c7b3a tempest-VolumesActionsTest-1761414393 tempest-VolumesActionsTest-1761414393-project] 10.222.0.58 "GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289" status: 404 len: 111 microversion: 2.1 time: 0.033849 May 17 12:18:15.759546 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 533/1078] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:18:15 2022] GET /compute/v2.1/servers/25174089-91e4-4824-b85a-7778730e3289 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:18:55.913599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0d90dfdb-79d3-4969-9123-62fb12e6e37a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1445039270"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:18:55.914251 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0d90dfdb-79d3-4969-9123-62fb12e6e37a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:55.920325 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d90dfdb-79d3-4969-9123-62fb12e6e37a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:55.920783 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d90dfdb-79d3-4969-9123-62fb12e6e37a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:55.922227 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d90dfdb-79d3-4969-9123-62fb12e6e37a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:55.922672 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d90dfdb-79d3-4969-9123-62fb12e6e37a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:56.053489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.network.security_group_api [None req-0d90dfdb-79d3-4969-9123-62fb12e6e37a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Removing security group 46ab5eb0-183a-4086-9c79-d63470e071c5 from port 17a6f924-0238-4beb-a7c9-3059b4bb15f8 May 17 12:18:56.432258 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0d90dfdb-79d3-4969-9123-62fb12e6e37a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "POST /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/action" status: 202 len: 0 microversion: 2.1 time: 0.522556 May 17 12:18:56.435740 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 546/1079] 10.222.0.58 () {60 vars in 1277 bytes} [Tue May 17 12:18:55 2022] POST /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:18:56.446928 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-8dc5152b-7f5a-42c2-ba49-4e4cdec3565c req-999cae8f-65d8-4ce2-adda-109ee4383bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70", "tag": "17a6f924-0238-4beb-a7c9-3059b4bb15f8"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:18:56.457348 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-8dc5152b-7f5a-42c2-ba49-4e4cdec3565c req-999cae8f-65d8-4ce2-adda-109ee4383bf4 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:56.458160 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-8dc5152b-7f5a-42c2-ba49-4e4cdec3565c req-999cae8f-65d8-4ce2-adda-109ee4383bf4 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:56.479375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-8dc5152b-7f5a-42c2-ba49-4e4cdec3565c req-999cae8f-65d8-4ce2-adda-109ee4383bf4 service nova] Creating event network-changed:17a6f924-0238-4beb-a7c9-3059b4bb15f8 for instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 on hv-cinder-83769 May 17 12:18:56.499964 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-8dc5152b-7f5a-42c2-ba49-4e4cdec3565c req-999cae8f-65d8-4ce2-adda-109ee4383bf4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062540 May 17 12:18:56.505130 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 534/1080] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:18:57.890770 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8ef460eb-048e-4cc2-9a43-104c92a1fa4f tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:57.891323 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8ef460eb-048e-4cc2-9a43-104c92a1fa4f tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:57.897831 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8ef460eb-048e-4cc2-9a43-104c92a1fa4f tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:57.898653 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8ef460eb-048e-4cc2-9a43-104c92a1fa4f tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:57.899761 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8ef460eb-048e-4cc2-9a43-104c92a1fa4f tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:57.900322 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8ef460eb-048e-4cc2-9a43-104c92a1fa4f tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:57.984813 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.objects.instance [None req-8ef460eb-048e-4cc2-9a43-104c92a1fa4f tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lazy-loading 'services' on Instance uuid ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 {{(pid=117114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:18:58.060482 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8ef460eb-048e-4cc2-9a43-104c92a1fa4f tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments/33198abe-dba7-47bb-8940-fd5e9140232e" status: 202 len: 0 microversion: 2.1 time: 0.174530 May 17 12:18:58.061393 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 547/1081] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:18:57 2022] DELETE /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments/33198abe-dba7-47bb-8940-fd5e9140232e => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:18:58.071213 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8f1996f3-6c9b-4506-8713-6b71f2cdd250 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:58.072469 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8f1996f3-6c9b-4506-8713-6b71f2cdd250 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:58.079572 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8f1996f3-6c9b-4506-8713-6b71f2cdd250 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:58.080397 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8f1996f3-6c9b-4506-8713-6b71f2cdd250 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:58.081259 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8f1996f3-6c9b-4506-8713-6b71f2cdd250 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:58.081765 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8f1996f3-6c9b-4506-8713-6b71f2cdd250 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:58.113874 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8f1996f3-6c9b-4506-8713-6b71f2cdd250 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047355 May 17 12:18:58.114473 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 535/1082] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:18:58 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:18:58.520474 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-0e66fe9a-b8c2-4d56-8e12-158cb5399c79 req-48e41fef-fc0d-4593-86b6-22497093904c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70", "tag": "17a6f924-0238-4beb-a7c9-3059b4bb15f8"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:18:58.529154 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-0e66fe9a-b8c2-4d56-8e12-158cb5399c79 req-48e41fef-fc0d-4593-86b6-22497093904c service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:58.529599 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-0e66fe9a-b8c2-4d56-8e12-158cb5399c79 req-48e41fef-fc0d-4593-86b6-22497093904c service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:58.543975 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-0e66fe9a-b8c2-4d56-8e12-158cb5399c79 req-48e41fef-fc0d-4593-86b6-22497093904c service nova] Creating event network-changed:17a6f924-0238-4beb-a7c9-3059b4bb15f8 for instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 on hv-cinder-83769 May 17 12:18:58.549602 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-0e66fe9a-b8c2-4d56-8e12-158cb5399c79 req-48e41fef-fc0d-4593-86b6-22497093904c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033145 May 17 12:18:58.550225 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 548/1083] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:18:59.126394 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-bc5d841c-9a55-4073-9d8d-d3f8e26f755a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:18:59.127333 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-bc5d841c-9a55-4073-9d8d-d3f8e26f755a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:18:59.133884 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc5d841c-9a55-4073-9d8d-d3f8e26f755a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:59.134342 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc5d841c-9a55-4073-9d8d-d3f8e26f755a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:59.135322 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc5d841c-9a55-4073-9d8d-d3f8e26f755a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:18:59.135767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc5d841c-9a55-4073-9d8d-d3f8e26f755a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:18:59.165975 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-bc5d841c-9a55-4073-9d8d-d3f8e26f755a tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 May 17 12:18:59.166477 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 536/1084] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:18:59 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:19:00.179120 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e78505f4-4705-4bb5-b393-398e601fa63e tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:00.180132 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e78505f4-4705-4bb5-b393-398e601fa63e tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:00.186296 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e78505f4-4705-4bb5-b393-398e601fa63e tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:00.186905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e78505f4-4705-4bb5-b393-398e601fa63e tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:00.187525 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e78505f4-4705-4bb5-b393-398e601fa63e tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:00.187968 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e78505f4-4705-4bb5-b393-398e601fa63e tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:00.215075 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e78505f4-4705-4bb5-b393-398e601fa63e tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040697 May 17 12:19:00.215563 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 549/1085] 10.222.0.58 () {58 vars in 1301 bytes} [Tue May 17 12:19:00 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 12:19:00.225900 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ee334d5f-cc68-412f-841f-1a209aff7a2b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:00.226399 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-ee334d5f-cc68-412f-841f-1a209aff7a2b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:00.232638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ee334d5f-cc68-412f-841f-1a209aff7a2b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:00.233084 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ee334d5f-cc68-412f-841f-1a209aff7a2b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:00.234486 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ee334d5f-cc68-412f-841f-1a209aff7a2b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:00.235006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-ee334d5f-cc68-412f-841f-1a209aff7a2b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:00.307700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-ee334d5f-cc68-412f-841f-1a209aff7a2b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] HTTP exception thrown: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 is not attached to volume 33198abe-dba7-47bb-8940-fd5e9140232e May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ee334d5f-cc68-412f-841f-1a209aff7a2b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Request method failure captured: May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: DELETE /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments/33198abe-dba7-47bb-8940-fd5e9140232e HTTP/1.1 May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig5G1ZO34AKqUWMaHkRWioJHTPxeY1hkYeSlm52dEThd8XMQTeoFu18OZzxHrJd3V24q4IiyH5p9TqSuFbKV_5hdwRM9z8oTWPS2d2-6sMGCgFR0pHDQ7SIQtqI5tmsnmdqh-bS6ueVIZa4o93QnDR966K_avDshM6PToZVT9LIPgFRA May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 2073530c2a5b4ad4a6543cdfa209c9f0 May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-TestMinimumBasicScenario-891030115 May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:19:00.319417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2073530c2a5b4ad4a6543cdfa209c9f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2073530c2a5b4ad4a6543cdfa209c9f0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2073530c2a5b4ad4a6543cdfa209c9f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2073530c2a5b4ad4a6543cdfa209c9f0"}]}] May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-TestMinimumBasicScenario-891030115 May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 2073530c2a5b4ad4a6543cdfa209c9f0 May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-TestMinimumBasicScenario-891030115 May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-TestMinimumBasicScenario-891030115-project May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: e125d4ed850d49789402a28e4cbb58e1 May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-TestMinimumBasicScenario-891030115-project May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:19:00.321147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 is not attached to volume 33198abe-dba7-47bb-8940-fd5e9140232e May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'server_id': 'ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70', 'id': '33198abe-dba7-47bb-8940-fd5e9140232e'} May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 33198abe-dba7-47bb-8940-fd5e9140232e. May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:19:00.322045 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 is not attached to volume 33198abe-dba7-47bb-8940-fd5e9140232e May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 is not attached to volume 33198abe-dba7-47bb-8940-fd5e9140232e May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:19:00.323565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-ee334d5f-cc68-412f-841f-1a209aff7a2b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Returning 404 to user: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 is not attached to volume 33198abe-dba7-47bb-8940-fd5e9140232e {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:19:00.324766 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-ee334d5f-cc68-412f-841f-1a209aff7a2b tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments/33198abe-dba7-47bb-8940-fd5e9140232e" status: 404 len: 154 microversion: 2.1 time: 0.098893 May 17 12:19:00.324766 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 537/1086] 10.222.0.58 () {58 vars in 1415 bytes} [Tue May 17 12:19:00 2022] DELETE /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70/os-volume_attachments/33198abe-dba7-47bb-8940-fd5e9140232e => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:19:01.453911 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-07716b29-c07f-4480-9322-f98ae16281b3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:01.454398 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-07716b29-c07f-4480-9322-f98ae16281b3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:01.460698 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-07716b29-c07f-4480-9322-f98ae16281b3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:01.461158 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-07716b29-c07f-4480-9322-f98ae16281b3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:01.461925 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-07716b29-c07f-4480-9322-f98ae16281b3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:01.462364 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-07716b29-c07f-4480-9322-f98ae16281b3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:01.486708 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-07716b29-c07f-4480-9322-f98ae16281b3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:19:01.567148 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-07716b29-c07f-4480-9322-f98ae16281b3 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 204 len: 0 microversion: 2.1 time: 0.117773 May 17 12:19:01.568162 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 550/1087] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:19:01 2022] DELETE /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:19:01.576788 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-11dfc327-7d5c-4a50-86b3-028da0e8c8e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:01.578244 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-11dfc327-7d5c-4a50-86b3-028da0e8c8e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:01.584646 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-11dfc327-7d5c-4a50-86b3-028da0e8c8e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:01.585097 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-11dfc327-7d5c-4a50-86b3-028da0e8c8e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:01.585866 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-11dfc327-7d5c-4a50-86b3-028da0e8c8e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:01.586298 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-11dfc327-7d5c-4a50-86b3-028da0e8c8e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:01.721482 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-11dfc327-7d5c-4a50-86b3-028da0e8c8e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:01.729239 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-11dfc327-7d5c-4a50-86b3-028da0e8c8e6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1554 microversion: 2.1 time: 0.156726 May 17 12:19:01.729892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 538/1088] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:01 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:02.747776 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a2914db6-5094-4b50-ac30-eca584a1bc11 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:02.748899 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a2914db6-5094-4b50-ac30-eca584a1bc11 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:02.755651 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a2914db6-5094-4b50-ac30-eca584a1bc11 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:02.756106 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a2914db6-5094-4b50-ac30-eca584a1bc11 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:02.757024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a2914db6-5094-4b50-ac30-eca584a1bc11 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:02.757462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a2914db6-5094-4b50-ac30-eca584a1bc11 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:02.888231 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a2914db6-5094-4b50-ac30-eca584a1bc11 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:02.896259 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a2914db6-5094-4b50-ac30-eca584a1bc11 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1554 microversion: 2.1 time: 0.152981 May 17 12:19:02.896826 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 551/1089] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:02 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:03.913916 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2d64ff90-6ad1-4c2e-85d4-50ffac799f08 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:03.914606 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2d64ff90-6ad1-4c2e-85d4-50ffac799f08 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:03.921051 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2d64ff90-6ad1-4c2e-85d4-50ffac799f08 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:03.921519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2d64ff90-6ad1-4c2e-85d4-50ffac799f08 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:03.922320 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2d64ff90-6ad1-4c2e-85d4-50ffac799f08 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:03.922758 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2d64ff90-6ad1-4c2e-85d4-50ffac799f08 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:04.057674 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2d64ff90-6ad1-4c2e-85d4-50ffac799f08 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:04.065744 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2d64ff90-6ad1-4c2e-85d4-50ffac799f08 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1554 microversion: 2.1 time: 0.155637 May 17 12:19:04.066332 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 539/1090] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:03 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:04.824741 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-d31cfe4f-96b4-421a-8cd8-5738465876c5 req-d77f55b6-64e9-45ba-b8ef-b10221407f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70", "name": "network-vif-deleted", "tag": "17a6f924-0238-4beb-a7c9-3059b4bb15f8"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:19:04.834464 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-d31cfe4f-96b4-421a-8cd8-5738465876c5 req-d77f55b6-64e9-45ba-b8ef-b10221407f52 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:04.834905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-d31cfe4f-96b4-421a-8cd8-5738465876c5 req-d77f55b6-64e9-45ba-b8ef-b10221407f52 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:04.845709 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-d31cfe4f-96b4-421a-8cd8-5738465876c5 req-d77f55b6-64e9-45ba-b8ef-b10221407f52 service nova] Creating event network-vif-deleted:17a6f924-0238-4beb-a7c9-3059b4bb15f8 for instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 on hv-cinder-83769 May 17 12:19:04.850376 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-d31cfe4f-96b4-421a-8cd8-5738465876c5 req-d77f55b6-64e9-45ba-b8ef-b10221407f52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029889 May 17 12:19:04.851269 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 552/1091] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:19:05.082127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:05.082672 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:05.088717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:05.089163 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:05.089928 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:05.090364 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:05.121077 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:05.121529 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:05.121979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.objects.instance [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lazy-loading 'fault' on Instance uuid ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 {{(pid=117113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:19:05.163784 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125d4ed850d49789402a28e4cbb58e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2073530c2a5b4ad4a6543cdfa209c9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:05.172760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-48550bf6-c222-4abf-85b9-d6bc47416154 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 200 len: 1348 microversion: 2.1 time: 0.094497 May 17 12:19:05.173356 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 540/1092] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:05 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:06.190838 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ee00786a-a491-4025-ac3a-2e62446766b6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:06.191547 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-ee00786a-a491-4025-ac3a-2e62446766b6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] [instance: ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:06.197771 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ee00786a-a491-4025-ac3a-2e62446766b6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:06.198224 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ee00786a-a491-4025-ac3a-2e62446766b6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:06.199018 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ee00786a-a491-4025-ac3a-2e62446766b6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:06.199461 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-ee00786a-a491-4025-ac3a-2e62446766b6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:06.212868 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-ee00786a-a491-4025-ac3a-2e62446766b6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] HTTP exception thrown: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 could not be found. May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ee00786a-a491-4025-ac3a-2e62446766b6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Request method failure captured: May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 HTTP/1.1 May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig5G1ZO34AKqUWMaHkRWioJHTPxeY1hkYeSlm52dEThd8XMQTeoFu18OZzxHrJd3V24q4IiyH5p9TqSuFbKV_5hdwRM9z8oTWPS2d2-6sMGCgFR0pHDQ7SIQtqI5tmsnmdqh-bS6ueVIZa4o93QnDR966K_avDshM6PToZVT9LIPgFRA May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 2073530c2a5b4ad4a6543cdfa209c9f0 May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-TestMinimumBasicScenario-891030115 May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:19:06.214486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2073530c2a5b4ad4a6543cdfa209c9f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2073530c2a5b4ad4a6543cdfa209c9f0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2073530c2a5b4ad4a6543cdfa209c9f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2073530c2a5b4ad4a6543cdfa209c9f0"}]}] May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-TestMinimumBasicScenario-891030115 May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 2073530c2a5b4ad4a6543cdfa209c9f0 May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-TestMinimumBasicScenario-891030115 May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-TestMinimumBasicScenario-891030115-project May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: e125d4ed850d49789402a28e4cbb58e1 May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-TestMinimumBasicScenario-891030115-project May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 could not be found. May 17 12:19:06.216023 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': 'ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70'} May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 could not be found. May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:19:06.216955 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 could not be found. May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 could not be found. May 17 12:19:06.219052 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:19:06.220589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-ee00786a-a491-4025-ac3a-2e62446766b6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Returning 404 to user: Instance ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:19:06.220589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-ee00786a-a491-4025-ac3a-2e62446766b6 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70" status: 404 len: 111 microversion: 2.1 time: 0.029685 May 17 12:19:06.220589 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 553/1093] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:06 2022] GET /compute/v2.1/servers/ecc3a2d6-0fcd-4ad6-b4cc-f9f045470b70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:19:06.225141 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-22e1bba1-21d5-414c-b02e-a410f4175340 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] Calling method '.version_select at 0x7f2db4460040>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:06.242980 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-22e1bba1-21d5-414c-b02e-a410f4175340 tempest-TestMinimumBasicScenario-891030115 tempest-TestMinimumBasicScenario-891030115-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2093136818" status: 202 len: 0 microversion: 2.1 time: 0.021578 May 17 12:19:06.243544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 541/1094] 10.222.0.58 () {58 vars in 1271 bytes} [Tue May 17 12:19:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2093136818 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 12:19:35.764791 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1381958590", "imageRef": "f7f07a08-9262-4433-9070-197c4349e260", "flavorRef": "452"}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:19:35.814350 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.network.neutron [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] validate_networks() for None {{(pid=117114) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:19:36.095784 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Flavor limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:19:36.096315 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Image limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:19:36.096865 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Flavor pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:19:36.097351 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Image pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:19:36.097859 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:19:36.106889 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:36.107355 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:36.108164 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:36.109311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:36.125349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Getting quotas for project fe68b341b9a14a9d94e87cd6c5466f6a. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:19:36.129237 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Getting quotas for user 34b2cf3184a045ab9e8870b3b0826620 and project fe68b341b9a14a9d94e87cd6c5466f6a. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:19:36.139830 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Going to run 1 instances... {{(pid=117114) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:19:36.142107 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7f07a08-9262-4433-9070-197c4349e260',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:19:36.185218 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [bc3678ee-1d21-4501-be83-b65fb7a17e4e] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 12:19:37.193912 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO oslo.messaging._drivers.impl_rabbit [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [bc3678ee-1d21-4501-be83-b65fb7a17e4e] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 59410. May 17 12:19:37.198093 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2040cb0a-1606-4231-bda8-6582ce51f477 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.437435 May 17 12:19:37.199251 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 554/1095] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:19:37.209032 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d345a822-0e53-4ff0-898e-f8b644922c52 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:37.210301 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d345a822-0e53-4ff0-898e-f8b644922c52 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:37.267222 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d345a822-0e53-4ff0-898e-f8b644922c52 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:37.273811 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d345a822-0e53-4ff0-898e-f8b644922c52 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1215 microversion: 2.1 time: 0.068533 May 17 12:19:37.274379 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 542/1096] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:37 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:38.291709 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-12946b45-64bf-4665-9c4b-1b4d40d1ab7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:38.292358 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-12946b45-64bf-4665-9c4b-1b4d40d1ab7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:38.299303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-12946b45-64bf-4665-9c4b-1b4d40d1ab7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:38.299748 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-12946b45-64bf-4665-9c4b-1b4d40d1ab7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:38.300536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-12946b45-64bf-4665-9c4b-1b4d40d1ab7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:38.300967 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-12946b45-64bf-4665-9c4b-1b4d40d1ab7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:38.361833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-12946b45-64bf-4665-9c4b-1b4d40d1ab7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:38.369303 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-12946b45-64bf-4665-9c4b-1b4d40d1ab7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1219 microversion: 2.1 time: 0.082062 May 17 12:19:38.369859 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 555/1097] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:38 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:39.385683 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8631f602-558f-4a80-9491-944f5fd67c04 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:39.386360 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8631f602-558f-4a80-9491-944f5fd67c04 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:39.392948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8631f602-558f-4a80-9491-944f5fd67c04 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:39.393406 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8631f602-558f-4a80-9491-944f5fd67c04 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:39.394189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8631f602-558f-4a80-9491-944f5fd67c04 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:39.394633 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8631f602-558f-4a80-9491-944f5fd67c04 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:39.462559 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8631f602-558f-4a80-9491-944f5fd67c04 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:39.470935 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8631f602-558f-4a80-9491-944f5fd67c04 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1267 microversion: 2.1 time: 0.089184 May 17 12:19:39.471510 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 543/1098] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:39 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:40.488884 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-593263cb-b11f-4f9a-8654-9b8e09137ce3 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:40.489628 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-593263cb-b11f-4f9a-8654-9b8e09137ce3 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:40.496127 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-593263cb-b11f-4f9a-8654-9b8e09137ce3 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:40.496607 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-593263cb-b11f-4f9a-8654-9b8e09137ce3 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:40.497384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-593263cb-b11f-4f9a-8654-9b8e09137ce3 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:40.497873 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-593263cb-b11f-4f9a-8654-9b8e09137ce3 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:40.576193 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-593263cb-b11f-4f9a-8654-9b8e09137ce3 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:40.584247 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-593263cb-b11f-4f9a-8654-9b8e09137ce3 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1273 microversion: 2.1 time: 0.099355 May 17 12:19:40.584941 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 556/1099] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:40 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:41.444707 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-480ded63-3661-449c-9f39-7ac9c7389d56 req-40195dd3-a2cd-4d35-a5d0-264bdff262f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0839721b-0ef5-4ad3-9cc4-b3bc99af2c50", "tag": "7dbf5c98-3253-4cab-91cc-b68c0e71ed07"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:19:41.456085 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-480ded63-3661-449c-9f39-7ac9c7389d56 req-40195dd3-a2cd-4d35-a5d0-264bdff262f5 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:41.458298 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-480ded63-3661-449c-9f39-7ac9c7389d56 req-40195dd3-a2cd-4d35-a5d0-264bdff262f5 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:41.476173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-480ded63-3661-449c-9f39-7ac9c7389d56 req-40195dd3-a2cd-4d35-a5d0-264bdff262f5 service nova] Creating event network-changed:7dbf5c98-3253-4cab-91cc-b68c0e71ed07 for instance 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 on hv-cinder-83769 May 17 12:19:41.481719 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-480ded63-3661-449c-9f39-7ac9c7389d56 req-40195dd3-a2cd-4d35-a5d0-264bdff262f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040715 May 17 12:19:41.486233 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 544/1100] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:19:41.604616 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a792a408-b33e-4306-8f23-866acf895bbd tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:41.605207 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a792a408-b33e-4306-8f23-866acf895bbd tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:41.615416 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a792a408-b33e-4306-8f23-866acf895bbd tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:41.615868 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a792a408-b33e-4306-8f23-866acf895bbd tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:41.616683 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a792a408-b33e-4306-8f23-866acf895bbd tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:41.617126 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a792a408-b33e-4306-8f23-866acf895bbd tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:41.811027 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a792a408-b33e-4306-8f23-866acf895bbd tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:41.818967 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a792a408-b33e-4306-8f23-866acf895bbd tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1315 microversion: 2.1 time: 0.220545 May 17 12:19:41.819540 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 557/1101] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:41 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:42.837196 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d1eb5997-cb90-4237-8e12-8ce286069d15 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:42.837905 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d1eb5997-cb90-4237-8e12-8ce286069d15 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:42.844123 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1eb5997-cb90-4237-8e12-8ce286069d15 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:42.844603 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1eb5997-cb90-4237-8e12-8ce286069d15 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:42.845405 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1eb5997-cb90-4237-8e12-8ce286069d15 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:42.845843 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d1eb5997-cb90-4237-8e12-8ce286069d15 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:42.979161 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d1eb5997-cb90-4237-8e12-8ce286069d15 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:42.987185 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d1eb5997-cb90-4237-8e12-8ce286069d15 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1315 microversion: 2.1 time: 0.154719 May 17 12:19:42.987753 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 545/1102] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:42 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:44.005361 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3186fcd7-6d2a-429e-8b8c-e417003d58f6 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:44.005982 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-3186fcd7-6d2a-429e-8b8c-e417003d58f6 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:44.013729 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3186fcd7-6d2a-429e-8b8c-e417003d58f6 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:44.014262 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3186fcd7-6d2a-429e-8b8c-e417003d58f6 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:44.015246 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3186fcd7-6d2a-429e-8b8c-e417003d58f6 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:44.016435 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-3186fcd7-6d2a-429e-8b8c-e417003d58f6 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:44.527395 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-3186fcd7-6d2a-429e-8b8c-e417003d58f6 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:44.535333 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3186fcd7-6d2a-429e-8b8c-e417003d58f6 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1315 microversion: 2.1 time: 0.535201 May 17 12:19:44.536283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 558/1103] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:43 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:19:45.552532 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2b17506f-8aac-486f-a9ad-4cbe6cf0c1af tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:45.553137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2b17506f-8aac-486f-a9ad-4cbe6cf0c1af tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:45.559738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2b17506f-8aac-486f-a9ad-4cbe6cf0c1af tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:45.560417 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2b17506f-8aac-486f-a9ad-4cbe6cf0c1af tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:45.561250 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2b17506f-8aac-486f-a9ad-4cbe6cf0c1af tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:45.562007 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2b17506f-8aac-486f-a9ad-4cbe6cf0c1af tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:45.707336 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2b17506f-8aac-486f-a9ad-4cbe6cf0c1af tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:45.715225 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2b17506f-8aac-486f-a9ad-4cbe6cf0c1af tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1315 microversion: 2.1 time: 0.167058 May 17 12:19:45.715827 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 546/1104] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:45 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:46.733360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-cea6a590-0bd7-4d51-8b75-2800a80ae080 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:46.733976 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-cea6a590-0bd7-4d51-8b75-2800a80ae080 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:46.740943 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cea6a590-0bd7-4d51-8b75-2800a80ae080 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:46.741394 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cea6a590-0bd7-4d51-8b75-2800a80ae080 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:46.742162 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cea6a590-0bd7-4d51-8b75-2800a80ae080 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:46.742598 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-cea6a590-0bd7-4d51-8b75-2800a80ae080 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:46.871062 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-cea6a590-0bd7-4d51-8b75-2800a80ae080 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:46.878820 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-cea6a590-0bd7-4d51-8b75-2800a80ae080 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1315 microversion: 2.1 time: 0.149299 May 17 12:19:46.879381 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 559/1105] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:46 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:47.092927 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-441f41fa-4518-4807-9ce6-78225cba3593 req-345b34af-e847-474c-b1cc-d1d61c1682d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0839721b-0ef5-4ad3-9cc4-b3bc99af2c50", "name": "network-vif-plugged", "status": "completed", "tag": "7dbf5c98-3253-4cab-91cc-b68c0e71ed07"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:19:47.103284 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-441f41fa-4518-4807-9ce6-78225cba3593 req-345b34af-e847-474c-b1cc-d1d61c1682d0 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:47.103748 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-441f41fa-4518-4807-9ce6-78225cba3593 req-345b34af-e847-474c-b1cc-d1d61c1682d0 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:47.117755 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-441f41fa-4518-4807-9ce6-78225cba3593 req-345b34af-e847-474c-b1cc-d1d61c1682d0 service nova] Creating event network-vif-plugged:7dbf5c98-3253-4cab-91cc-b68c0e71ed07 for instance 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 on hv-cinder-83769 May 17 12:19:47.122806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-441f41fa-4518-4807-9ce6-78225cba3593 req-345b34af-e847-474c-b1cc-d1d61c1682d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033671 May 17 12:19:47.123565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 547/1106] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:19:47.896047 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a3ce39a3-c9ba-436f-b87d-68235ee45083 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:47.896686 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a3ce39a3-c9ba-436f-b87d-68235ee45083 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:47.903191 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a3ce39a3-c9ba-436f-b87d-68235ee45083 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:47.903647 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a3ce39a3-c9ba-436f-b87d-68235ee45083 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:47.904448 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a3ce39a3-c9ba-436f-b87d-68235ee45083 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:47.904891 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a3ce39a3-c9ba-436f-b87d-68235ee45083 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:48.034736 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a3ce39a3-c9ba-436f-b87d-68235ee45083 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:48.042016 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a3ce39a3-c9ba-436f-b87d-68235ee45083 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1315 microversion: 2.1 time: 0.149842 May 17 12:19:48.042571 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 560/1107] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:47 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:49.060167 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-80401aff-61c7-4de2-ae94-460602aa58f8 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:49.060823 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-80401aff-61c7-4de2-ae94-460602aa58f8 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:49.068006 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80401aff-61c7-4de2-ae94-460602aa58f8 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:49.068485 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80401aff-61c7-4de2-ae94-460602aa58f8 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:49.069256 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80401aff-61c7-4de2-ae94-460602aa58f8 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:49.069697 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-80401aff-61c7-4de2-ae94-460602aa58f8 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:49.201479 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-80401aff-61c7-4de2-ae94-460602aa58f8 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:49.209307 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-80401aff-61c7-4de2-ae94-460602aa58f8 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1465 microversion: 2.1 time: 0.153635 May 17 12:19:49.209879 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 548/1108] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:49 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:49.245922 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-902a5240-d744-4682-b416-fd20b756bff1 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:49.246419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-902a5240-d744-4682-b416-fd20b756bff1 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:49.253217 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-902a5240-d744-4682-b416-fd20b756bff1 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:49.253667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-902a5240-d744-4682-b416-fd20b756bff1 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:49.254428 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-902a5240-d744-4682-b416-fd20b756bff1 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:49.254864 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-902a5240-d744-4682-b416-fd20b756bff1 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:49.279122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-902a5240-d744-4682-b416-fd20b756bff1 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:19:49.350356 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-902a5240-d744-4682-b416-fd20b756bff1 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 204 len: 0 microversion: 2.1 time: 0.107826 May 17 12:19:49.350994 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 561/1109] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:19:49 2022] DELETE /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:19:49.360304 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-bba0a0c5-7b4a-4691-add8-c4ad4f776b7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:49.361143 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-bba0a0c5-7b4a-4691-add8-c4ad4f776b7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:49.367008 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bba0a0c5-7b4a-4691-add8-c4ad4f776b7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:49.367460 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bba0a0c5-7b4a-4691-add8-c4ad4f776b7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:49.368263 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bba0a0c5-7b4a-4691-add8-c4ad4f776b7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:49.368704 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bba0a0c5-7b4a-4691-add8-c4ad4f776b7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:49.497218 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-bba0a0c5-7b4a-4691-add8-c4ad4f776b7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:49.504776 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-bba0a0c5-7b4a-4691-add8-c4ad4f776b7b tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1471 microversion: 2.1 time: 0.149264 May 17 12:19:49.505344 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 549/1110] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:49 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:50.522470 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a2ac7c1d-9dee-4743-8305-58576f2075b4 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:50.523177 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a2ac7c1d-9dee-4743-8305-58576f2075b4 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:50.529755 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a2ac7c1d-9dee-4743-8305-58576f2075b4 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:50.530211 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a2ac7c1d-9dee-4743-8305-58576f2075b4 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:50.531036 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a2ac7c1d-9dee-4743-8305-58576f2075b4 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:50.531473 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a2ac7c1d-9dee-4743-8305-58576f2075b4 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:50.664277 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a2ac7c1d-9dee-4743-8305-58576f2075b4 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:50.671493 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a2ac7c1d-9dee-4743-8305-58576f2075b4 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1471 microversion: 2.1 time: 0.153216 May 17 12:19:50.672714 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 562/1111] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:50 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:51.444396 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-b4118605-45fa-4434-8720-2b056ad62a62 req-f5472283-2eab-43c3-99e9-27c533bdad5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0839721b-0ef5-4ad3-9cc4-b3bc99af2c50", "name": "network-vif-deleted", "tag": "7dbf5c98-3253-4cab-91cc-b68c0e71ed07"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:19:51.455297 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-b4118605-45fa-4434-8720-2b056ad62a62 req-f5472283-2eab-43c3-99e9-27c533bdad5d service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:51.455838 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-b4118605-45fa-4434-8720-2b056ad62a62 req-f5472283-2eab-43c3-99e9-27c533bdad5d service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:51.470622 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-b4118605-45fa-4434-8720-2b056ad62a62 req-f5472283-2eab-43c3-99e9-27c533bdad5d service nova] Creating event network-vif-deleted:7dbf5c98-3253-4cab-91cc-b68c0e71ed07 for instance 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 on hv-cinder-83769 May 17 12:19:51.476003 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-b4118605-45fa-4434-8720-2b056ad62a62 req-f5472283-2eab-43c3-99e9-27c533bdad5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035189 May 17 12:19:51.476892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 550/1112] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:19:51.689055 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:51.689612 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:51.695884 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:51.696372 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:51.697135 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:51.697571 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:51.727361 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:51.727804 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:51.728270 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.objects.instance [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lazy-loading 'fault' on Instance uuid 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 {{(pid=117114) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 12:19:51.769746 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2cf3184a045ab9e8870b3b0826620', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe68b341b9a14a9d94e87cd6c5466f6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:19:51.777019 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-462b9777-797c-4e84-8dee-1797881bed54 tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 200 len: 1305 microversion: 2.1 time: 0.091986 May 17 12:19:51.777584 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 563/1113] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:51 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:19:52.795377 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3fda6e64-0d94-4430-b49c-88d64aa40bec tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:19:52.796088 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-3fda6e64-0d94-4430-b49c-88d64aa40bec tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] [instance: 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:19:52.802898 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3fda6e64-0d94-4430-b49c-88d64aa40bec tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:52.803349 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3fda6e64-0d94-4430-b49c-88d64aa40bec tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:52.804117 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3fda6e64-0d94-4430-b49c-88d64aa40bec tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:19:52.804581 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-3fda6e64-0d94-4430-b49c-88d64aa40bec tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:19:52.817972 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-3fda6e64-0d94-4430-b49c-88d64aa40bec tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] HTTP exception thrown: Instance 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 could not be found. May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3fda6e64-0d94-4430-b49c-88d64aa40bec tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Request method failure captured: May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 HTTP/1.1 May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig5LW9SbCDkeBhSHUBYQviDmvXFHGkB1-XU7_5d_P8cugLK63jtqDQgJujygWjmqls-x0hUD4rhQAlEoQOYzcIEWbs8Z-Y0j2IUwJ9LwQl8xmY73YssE0Pk747ce2gLcHoBwBBLYuaKafbYJWnl2Q0ljcDns-k6dz4koZXDm-EnxUq-w May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: fe68b341b9a14a9d94e87cd6c5466f6a May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-VolumesNegativeTest-825429392 May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:19:52.819552 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe68b341b9a14a9d94e87cd6c5466f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fe68b341b9a14a9d94e87cd6c5466f6a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fe68b341b9a14a9d94e87cd6c5466f6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fe68b341b9a14a9d94e87cd6c5466f6a"}]}] May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-VolumesNegativeTest-825429392 May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: fe68b341b9a14a9d94e87cd6c5466f6a May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-VolumesNegativeTest-825429392 May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-VolumesNegativeTest-825429392-project May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 34b2cf3184a045ab9e8870b3b0826620 May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-VolumesNegativeTest-825429392-project May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 could not be found. May 17 12:19:52.821295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '0839721b-0ef5-4ad3-9cc4-b3bc99af2c50'} May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 could not be found. May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:19:52.822191 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 could not be found. May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 could not be found. May 17 12:19:52.823484 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:19:52.824811 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-3fda6e64-0d94-4430-b49c-88d64aa40bec tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] Returning 404 to user: Instance 0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:19:52.824811 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-3fda6e64-0d94-4430-b49c-88d64aa40bec tempest-VolumesNegativeTest-825429392 tempest-VolumesNegativeTest-825429392-project] 10.222.0.58 "GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50" status: 404 len: 111 microversion: 2.1 time: 0.030311 May 17 12:19:52.824811 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 551/1114] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:19:52 2022] GET /compute/v2.1/servers/0839721b-0ef5-4ad3-9cc4-b3bc99af2c50 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:20:06.833706 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-3dd5b0d4-1704-4a15-a5b5-3109ec7f2476 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Action: 'create', calling method: .version_select at 0x7f2db4275280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1078707457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhGdnpewTkZSHPub53y48RGvep6ZIbah1l+9scphqzqHVcdyQI7xqdr3WiwCPR27JrjQvDgO99HiY/OZga1r2dB0rVNmuFBz4GeU9aPd/E3W95sDgup2ANoBHsriJN2WA=="}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:20:06.848304 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-3dd5b0d4-1704-4a15-a5b5-3109ec7f2476 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Getting quotas for project 96b18ec30b804e1e9ac7467a441c919b. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:20:06.852073 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-3dd5b0d4-1704-4a15-a5b5-3109ec7f2476 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Getting quotas for user 934f4b8dae3b410ebc6b8c03f47b15a7 and project 96b18ec30b804e1e9ac7467a441c919b. Resources: {'key_pairs'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:20:06.887986 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-3dd5b0d4-1704-4a15-a5b5-3109ec7f2476 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.240739 May 17 12:20:06.894839 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 564/1115] 10.222.0.58 () {60 vars in 1158 bytes} [Tue May 17 12:20:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:20:28.365936 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-200997163", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1078707457", "security_groups": [{"name": "tempest-secgroup-smoke-1166071696"}], "block_device_mapping_v2": [{"uuid": "c0581cfb-501f-4e51-b461-882f4d58103d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3d50c84-17ce-4c9f-9999-cbef27efd480"}]}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:20:28.477875 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] validate_networks() for [('e3d50c84-17ce-4c9f-9999-cbef27efd480', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:20:28.932369 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:20:28.932795 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:20:28.933271 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:20:28.933680 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:20:28.934115 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:20:28.942686 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:28.943137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:28.943945 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:28.944419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:28.960638 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Getting quotas for project 96b18ec30b804e1e9ac7467a441c919b. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:20:28.964643 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Getting quotas for user 934f4b8dae3b410ebc6b8c03f47b15a7 and project 96b18ec30b804e1e9ac7467a441c919b. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:20:29.020021 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:20:29.022089 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0581cfb-501f-4e51-b461-882f4d58103d',volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:20:29.150223 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2793cad7-8f99-4590-b302-291858be8254 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788332 May 17 12:20:29.150927 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 552/1116] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:20:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:20:29.161913 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-76f32fc6-407d-4cbf-8b30-d8a5a3e6f9cb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:29.162526 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-76f32fc6-407d-4cbf-8b30-d8a5a3e6f9cb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:29.216341 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-76f32fc6-407d-4cbf-8b30-d8a5a3e6f9cb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:29.223450 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-76f32fc6-407d-4cbf-8b30-d8a5a3e6f9cb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1094 microversion: 2.1 time: 0.065919 May 17 12:20:29.224002 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 565/1117] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:29 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:20:30.241017 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-10151053-85b7-45d8-8a97-b8ef54221914 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:30.241647 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-10151053-85b7-45d8-8a97-b8ef54221914 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:30.248437 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-10151053-85b7-45d8-8a97-b8ef54221914 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:30.249124 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-10151053-85b7-45d8-8a97-b8ef54221914 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:30.250010 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-10151053-85b7-45d8-8a97-b8ef54221914 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:30.250456 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-10151053-85b7-45d8-8a97-b8ef54221914 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:30.315075 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-10151053-85b7-45d8-8a97-b8ef54221914 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:30.322845 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-10151053-85b7-45d8-8a97-b8ef54221914 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1210 microversion: 2.1 time: 0.085636 May 17 12:20:30.323503 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 553/1118] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:30 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:31.340449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8e8bbba8-1025-4a20-a4ff-598b1faeebb0 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:31.341247 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8e8bbba8-1025-4a20-a4ff-598b1faeebb0 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:31.348468 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e8bbba8-1025-4a20-a4ff-598b1faeebb0 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:31.348928 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e8bbba8-1025-4a20-a4ff-598b1faeebb0 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:31.349720 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e8bbba8-1025-4a20-a4ff-598b1faeebb0 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:31.350159 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8e8bbba8-1025-4a20-a4ff-598b1faeebb0 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:31.568388 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-bc58b13e-ab0f-45d1-b143-eff123b3fa98 req-c7f0bd1b-a874-4cb1-bb50-c0908d1bd815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4114b620-de69-4409-8d15-45289549bade", "tag": "bc6e7e61-cb76-484d-a61f-57be445cc3e2"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:20:31.576821 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8e8bbba8-1025-4a20-a4ff-598b1faeebb0 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:31.586099 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-bc58b13e-ab0f-45d1-b143-eff123b3fa98 req-c7f0bd1b-a874-4cb1-bb50-c0908d1bd815 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:31.586547 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-bc58b13e-ab0f-45d1-b143-eff123b3fa98 req-c7f0bd1b-a874-4cb1-bb50-c0908d1bd815 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:31.589945 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8e8bbba8-1025-4a20-a4ff-598b1faeebb0 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.253412 May 17 12:20:31.590529 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 566/1119] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:31 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:31.603392 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-bc58b13e-ab0f-45d1-b143-eff123b3fa98 req-c7f0bd1b-a874-4cb1-bb50-c0908d1bd815 service nova] Creating event network-changed:bc6e7e61-cb76-484d-a61f-57be445cc3e2 for instance 4114b620-de69-4409-8d15-45289549bade on hv-cinder-83769 May 17 12:20:31.611004 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-bc58b13e-ab0f-45d1-b143-eff123b3fa98 req-c7f0bd1b-a874-4cb1-bb50-c0908d1bd815 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046932 May 17 12:20:31.612289 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 554/1120] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:20:32.607489 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b4579226-1ab9-43de-8455-22f87b3efc32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:32.608107 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b4579226-1ab9-43de-8455-22f87b3efc32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:32.615168 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b4579226-1ab9-43de-8455-22f87b3efc32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:32.615634 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b4579226-1ab9-43de-8455-22f87b3efc32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:32.616430 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b4579226-1ab9-43de-8455-22f87b3efc32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:32.616873 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b4579226-1ab9-43de-8455-22f87b3efc32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:32.747409 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b4579226-1ab9-43de-8455-22f87b3efc32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:32.755692 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b4579226-1ab9-43de-8455-22f87b3efc32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.152669 May 17 12:20:32.756312 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 567/1121] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:32 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:33.772877 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-edfa82fd-baa5-4f22-a1f8-7ff29b1f0975 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:33.773572 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-edfa82fd-baa5-4f22-a1f8-7ff29b1f0975 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:33.780131 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-edfa82fd-baa5-4f22-a1f8-7ff29b1f0975 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:33.780561 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-edfa82fd-baa5-4f22-a1f8-7ff29b1f0975 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:33.781328 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-edfa82fd-baa5-4f22-a1f8-7ff29b1f0975 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:33.781763 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-edfa82fd-baa5-4f22-a1f8-7ff29b1f0975 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:33.912803 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-edfa82fd-baa5-4f22-a1f8-7ff29b1f0975 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:33.920207 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-edfa82fd-baa5-4f22-a1f8-7ff29b1f0975 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.151439 May 17 12:20:33.920785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 555/1122] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:33 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:34.937421 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-20a3294a-4d80-4eb5-a747-9fdd15b44bcb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:34.938122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-20a3294a-4d80-4eb5-a747-9fdd15b44bcb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:34.944550 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20a3294a-4d80-4eb5-a747-9fdd15b44bcb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:34.945008 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20a3294a-4d80-4eb5-a747-9fdd15b44bcb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:34.945780 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20a3294a-4d80-4eb5-a747-9fdd15b44bcb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:34.946220 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-20a3294a-4d80-4eb5-a747-9fdd15b44bcb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:35.079587 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-20a3294a-4d80-4eb5-a747-9fdd15b44bcb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:35.086901 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-20a3294a-4d80-4eb5-a747-9fdd15b44bcb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.153372 May 17 12:20:35.087458 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 568/1123] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:34 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:36.103848 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-40b46fe1-42e1-4840-b8d4-40d07fa4cb24 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:36.104519 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-40b46fe1-42e1-4840-b8d4-40d07fa4cb24 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:36.111094 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-40b46fe1-42e1-4840-b8d4-40d07fa4cb24 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:36.111541 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-40b46fe1-42e1-4840-b8d4-40d07fa4cb24 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:36.112343 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-40b46fe1-42e1-4840-b8d4-40d07fa4cb24 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:36.112781 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-40b46fe1-42e1-4840-b8d4-40d07fa4cb24 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:36.241273 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-40b46fe1-42e1-4840-b8d4-40d07fa4cb24 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:36.248603 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-40b46fe1-42e1-4840-b8d4-40d07fa4cb24 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.148586 May 17 12:20:36.249173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 556/1124] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:36 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:37.266568 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-43da6974-9095-4cc1-9de1-620c0fbe978d tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:37.267180 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-43da6974-9095-4cc1-9de1-620c0fbe978d tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:37.273541 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-43da6974-9095-4cc1-9de1-620c0fbe978d tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:37.273995 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-43da6974-9095-4cc1-9de1-620c0fbe978d tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:37.274767 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-43da6974-9095-4cc1-9de1-620c0fbe978d tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:37.275205 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-43da6974-9095-4cc1-9de1-620c0fbe978d tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:37.412136 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-43da6974-9095-4cc1-9de1-620c0fbe978d tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:37.419434 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-43da6974-9095-4cc1-9de1-620c0fbe978d tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.157460 May 17 12:20:37.419993 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 569/1125] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:37 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:38.437293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-66ce636c-f54c-456c-8b0f-8a99bed46a69 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:38.437903 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-66ce636c-f54c-456c-8b0f-8a99bed46a69 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:38.444197 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-66ce636c-f54c-456c-8b0f-8a99bed46a69 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:38.444651 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-66ce636c-f54c-456c-8b0f-8a99bed46a69 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:38.445414 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-66ce636c-f54c-456c-8b0f-8a99bed46a69 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:38.445842 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-66ce636c-f54c-456c-8b0f-8a99bed46a69 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:38.574326 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-66ce636c-f54c-456c-8b0f-8a99bed46a69 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:38.582810 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-66ce636c-f54c-456c-8b0f-8a99bed46a69 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.149511 May 17 12:20:38.583387 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 557/1126] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:38 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:39.599867 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0c174d50-acd3-44a4-aa98-c6fff2d4a5d5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:39.600515 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0c174d50-acd3-44a4-aa98-c6fff2d4a5d5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:39.607114 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0c174d50-acd3-44a4-aa98-c6fff2d4a5d5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:39.607561 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0c174d50-acd3-44a4-aa98-c6fff2d4a5d5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:39.608384 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0c174d50-acd3-44a4-aa98-c6fff2d4a5d5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:39.609421 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0c174d50-acd3-44a4-aa98-c6fff2d4a5d5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:39.742433 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0c174d50-acd3-44a4-aa98-c6fff2d4a5d5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:39.749862 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0c174d50-acd3-44a4-aa98-c6fff2d4a5d5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.153747 May 17 12:20:39.750456 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 570/1127] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:39 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:40.766621 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0210a4ef-d0b4-46cb-89d9-73ae1e5cc2b5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:40.767271 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0210a4ef-d0b4-46cb-89d9-73ae1e5cc2b5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:40.773691 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0210a4ef-d0b4-46cb-89d9-73ae1e5cc2b5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:40.774137 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0210a4ef-d0b4-46cb-89d9-73ae1e5cc2b5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:40.774900 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0210a4ef-d0b4-46cb-89d9-73ae1e5cc2b5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:40.775338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0210a4ef-d0b4-46cb-89d9-73ae1e5cc2b5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:40.912073 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0210a4ef-d0b4-46cb-89d9-73ae1e5cc2b5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:40.919258 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0210a4ef-d0b4-46cb-89d9-73ae1e5cc2b5 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.156487 May 17 12:20:40.919825 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 558/1128] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:40 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:41.936529 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f77f45c5-430b-4072-a8c1-ed1cac529950 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:41.937399 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f77f45c5-430b-4072-a8c1-ed1cac529950 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:41.943640 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f77f45c5-430b-4072-a8c1-ed1cac529950 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:41.944090 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f77f45c5-430b-4072-a8c1-ed1cac529950 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:41.944892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f77f45c5-430b-4072-a8c1-ed1cac529950 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:41.945332 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f77f45c5-430b-4072-a8c1-ed1cac529950 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:42.079685 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f77f45c5-430b-4072-a8c1-ed1cac529950 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:42.086966 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f77f45c5-430b-4072-a8c1-ed1cac529950 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.154293 May 17 12:20:42.087533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 571/1129] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:41 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:43.103760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-51ae278d-e50f-4066-bce8-414a01df04c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:43.104351 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-51ae278d-e50f-4066-bce8-414a01df04c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:43.111236 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-51ae278d-e50f-4066-bce8-414a01df04c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:43.111686 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-51ae278d-e50f-4066-bce8-414a01df04c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:43.112480 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-51ae278d-e50f-4066-bce8-414a01df04c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:43.112920 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-51ae278d-e50f-4066-bce8-414a01df04c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:43.241467 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-51ae278d-e50f-4066-bce8-414a01df04c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:43.248721 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-51ae278d-e50f-4066-bce8-414a01df04c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.148883 May 17 12:20:43.249295 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 559/1130] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:43 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:43.573996 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-f80c9f93-e94a-417f-914c-13f892ecb639 req-c7c68a64-44e3-4373-919f-7c32428bc62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4114b620-de69-4409-8d15-45289549bade", "name": "network-vif-plugged", "status": "completed", "tag": "bc6e7e61-cb76-484d-a61f-57be445cc3e2"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:20:43.583083 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-f80c9f93-e94a-417f-914c-13f892ecb639 req-c7c68a64-44e3-4373-919f-7c32428bc62d service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:43.583739 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-f80c9f93-e94a-417f-914c-13f892ecb639 req-c7c68a64-44e3-4373-919f-7c32428bc62d service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:43.597227 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-f80c9f93-e94a-417f-914c-13f892ecb639 req-c7c68a64-44e3-4373-919f-7c32428bc62d service nova] Creating event network-vif-plugged:bc6e7e61-cb76-484d-a61f-57be445cc3e2 for instance 4114b620-de69-4409-8d15-45289549bade on hv-cinder-83769 May 17 12:20:43.602870 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-f80c9f93-e94a-417f-914c-13f892ecb639 req-c7c68a64-44e3-4373-919f-7c32428bc62d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032604 May 17 12:20:43.603470 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 572/1131] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:20:44.265746 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-786cb83a-af8d-49b0-83bb-783c71032db9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:44.266374 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-786cb83a-af8d-49b0-83bb-783c71032db9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:44.273077 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-786cb83a-af8d-49b0-83bb-783c71032db9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:44.273531 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-786cb83a-af8d-49b0-83bb-783c71032db9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:44.274309 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-786cb83a-af8d-49b0-83bb-783c71032db9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:44.274745 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-786cb83a-af8d-49b0-83bb-783c71032db9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:44.406957 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-786cb83a-af8d-49b0-83bb-783c71032db9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:44.415133 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-786cb83a-af8d-49b0-83bb-783c71032db9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.153940 May 17 12:20:44.415722 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 560/1132] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:44 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:45.432787 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-8915bb7e-c0c2-4ed2-a520-c372e07f39c2 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:45.433486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-8915bb7e-c0c2-4ed2-a520-c372e07f39c2 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:45.440005 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8915bb7e-c0c2-4ed2-a520-c372e07f39c2 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:45.440496 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8915bb7e-c0c2-4ed2-a520-c372e07f39c2 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:45.441264 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8915bb7e-c0c2-4ed2-a520-c372e07f39c2 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:45.441705 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-8915bb7e-c0c2-4ed2-a520-c372e07f39c2 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:45.575389 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-8915bb7e-c0c2-4ed2-a520-c372e07f39c2 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:45.583919 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-8915bb7e-c0c2-4ed2-a520-c372e07f39c2 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1266 microversion: 2.1 time: 0.155442 May 17 12:20:45.584510 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 573/1133] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:45 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:46.600963 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-76df7d4c-cc42-4247-a03e-1526d473fff7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:46.601846 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-76df7d4c-cc42-4247-a03e-1526d473fff7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:46.608898 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76df7d4c-cc42-4247-a03e-1526d473fff7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:46.609357 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76df7d4c-cc42-4247-a03e-1526d473fff7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:46.610202 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76df7d4c-cc42-4247-a03e-1526d473fff7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:46.610637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-76df7d4c-cc42-4247-a03e-1526d473fff7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:46.737041 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-76df7d4c-cc42-4247-a03e-1526d473fff7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:46.744251 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-76df7d4c-cc42-4247-a03e-1526d473fff7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1452 microversion: 2.1 time: 0.147104 May 17 12:20:46.744815 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 561/1134] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:46 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:46.760618 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a66bbf3a-381b-4533-ab8f-ac7059806f6a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:20:46.761235 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a66bbf3a-381b-4533-ab8f-ac7059806f6a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:20:46.767490 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a66bbf3a-381b-4533-ab8f-ac7059806f6a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:46.767937 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a66bbf3a-381b-4533-ab8f-ac7059806f6a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:46.768735 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a66bbf3a-381b-4533-ab8f-ac7059806f6a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:46.769173 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a66bbf3a-381b-4533-ab8f-ac7059806f6a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:46.901492 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a66bbf3a-381b-4533-ab8f-ac7059806f6a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:20:46.909403 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a66bbf3a-381b-4533-ab8f-ac7059806f6a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1452 microversion: 2.1 time: 0.152658 May 17 12:20:46.909964 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 574/1135] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:20:46 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:20:48.489948 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-9cca60ee-8702-431f-a19c-d20076035a11 req-d903ce64-1478-4dd1-b8b6-aaf6dfcf4b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4114b620-de69-4409-8d15-45289549bade", "tag": "bc6e7e61-cb76-484d-a61f-57be445cc3e2"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:20:48.498266 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-9cca60ee-8702-431f-a19c-d20076035a11 req-d903ce64-1478-4dd1-b8b6-aaf6dfcf4b1a service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:20:48.498717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-9cca60ee-8702-431f-a19c-d20076035a11 req-d903ce64-1478-4dd1-b8b6-aaf6dfcf4b1a service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:20:48.510769 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-9cca60ee-8702-431f-a19c-d20076035a11 req-d903ce64-1478-4dd1-b8b6-aaf6dfcf4b1a service nova] Creating event network-changed:bc6e7e61-cb76-484d-a61f-57be445cc3e2 for instance 4114b620-de69-4409-8d15-45289549bade on hv-cinder-83769 May 17 12:20:48.516932 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-9cca60ee-8702-431f-a19c-d20076035a11 req-d903ce64-1478-4dd1-b8b6-aaf6dfcf4b1a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030583 May 17 12:20:48.517553 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 562/1136] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:23:02.399747 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR oslo.messaging._drivers.impl_rabbit [-] [21e9f075-94b6-4ee7-854e-cef73b9e9282] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 17 12:23:02.403320 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e04d013b-b9c8-4e8a-962a-5a637bc2a451 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:02.403856 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e04d013b-b9c8-4e8a-962a-5a637bc2a451 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:02.410463 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e04d013b-b9c8-4e8a-962a-5a637bc2a451 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:02.410905 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e04d013b-b9c8-4e8a-962a-5a637bc2a451 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:02.411686 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e04d013b-b9c8-4e8a-962a-5a637bc2a451 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:02.412132 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-e04d013b-b9c8-4e8a-962a-5a637bc2a451 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:02.437422 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e04d013b-b9c8-4e8a-962a-5a637bc2a451 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:23:02.511409 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e04d013b-b9c8-4e8a-962a-5a637bc2a451 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 204 len: 0 microversion: 2.1 time: 0.113502 May 17 12:23:02.512150 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 575/1137] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:23:02 2022] DELETE /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:23:02.520874 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85a6ddbe-2911-46dc-89b1-d719a592b8cb] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 17 12:23:02.525504 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-862424f1-93ab-4f3d-8783-22059a091b32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:02.526487 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-862424f1-93ab-4f3d-8783-22059a091b32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:02.534281 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-862424f1-93ab-4f3d-8783-22059a091b32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:02.534741 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-862424f1-93ab-4f3d-8783-22059a091b32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:02.535792 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-862424f1-93ab-4f3d-8783-22059a091b32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:02.536472 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-862424f1-93ab-4f3d-8783-22059a091b32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:02.750163 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-862424f1-93ab-4f3d-8783-22059a091b32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:02.758884 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-862424f1-93ab-4f3d-8783-22059a091b32 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1575 microversion: 2.1 time: 0.241844 May 17 12:23:02.759476 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 563/1138] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:02 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1575 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:23:03.776396 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5b98049e-1832-4df5-b937-89c1deac9cbb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:03.777093 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5b98049e-1832-4df5-b937-89c1deac9cbb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:03.788449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO oslo.messaging._drivers.impl_rabbit [-] [21e9f075-94b6-4ee7-854e-cef73b9e9282] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60056. May 17 12:23:03.792416 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b98049e-1832-4df5-b937-89c1deac9cbb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:03.792868 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b98049e-1832-4df5-b937-89c1deac9cbb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:03.793647 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b98049e-1832-4df5-b937-89c1deac9cbb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:03.794079 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5b98049e-1832-4df5-b937-89c1deac9cbb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:03.975223 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-5b98049e-1832-4df5-b937-89c1deac9cbb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:03.982573 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5b98049e-1832-4df5-b937-89c1deac9cbb tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1575 microversion: 2.1 time: 0.210542 May 17 12:23:03.983129 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 576/1139] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:03 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:05.000338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-f4dcc18f-012a-41b2-8777-896b6c224051 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:05.002416 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-f4dcc18f-012a-41b2-8777-896b6c224051 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:05.009954 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f4dcc18f-012a-41b2-8777-896b6c224051 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:05.010409 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f4dcc18f-012a-41b2-8777-896b6c224051 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:05.011198 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f4dcc18f-012a-41b2-8777-896b6c224051 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:05.011641 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-f4dcc18f-012a-41b2-8777-896b6c224051 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:05.031617 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO oslo.messaging._drivers.impl_rabbit [-] [85a6ddbe-2911-46dc-89b1-d719a592b8cb] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60062. May 17 12:23:05.075968 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-f4dcc18f-012a-41b2-8777-896b6c224051 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:05.084871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-f4dcc18f-012a-41b2-8777-896b6c224051 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 200 len: 1507 microversion: 2.1 time: 0.088395 May 17 12:23:05.086300 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 564/1140] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:04 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 1507 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:05.199645 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-1d021c05-531d-49f1-9d3c-e1395d014112 req-56067520-a170-40db-a1c3-b46b7af39cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4114b620-de69-4409-8d15-45289549bade", "name": "network-vif-deleted", "tag": "bc6e7e61-cb76-484d-a61f-57be445cc3e2"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:23:05.209313 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-1d021c05-531d-49f1-9d3c-e1395d014112 req-56067520-a170-40db-a1c3-b46b7af39cca service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:05.209760 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-1d021c05-531d-49f1-9d3c-e1395d014112 req-56067520-a170-40db-a1c3-b46b7af39cca service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:05.222667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-1d021c05-531d-49f1-9d3c-e1395d014112 req-56067520-a170-40db-a1c3-b46b7af39cca service nova] Creating event network-vif-deleted:bc6e7e61-cb76-484d-a61f-57be445cc3e2 for instance 4114b620-de69-4409-8d15-45289549bade on hv-cinder-83769 May 17 12:23:05.227687 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-1d021c05-531d-49f1-9d3c-e1395d014112 req-56067520-a170-40db-a1c3-b46b7af39cca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093589 May 17 12:23:05.228268 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 577/1141] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:23:06.102850 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fa675ebe-c830-44c7-a059-ed0f1af1ba28 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:06.103497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-fa675ebe-c830-44c7-a059-ed0f1af1ba28 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:06.110851 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fa675ebe-c830-44c7-a059-ed0f1af1ba28 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:06.111324 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fa675ebe-c830-44c7-a059-ed0f1af1ba28 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:06.112203 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fa675ebe-c830-44c7-a059-ed0f1af1ba28 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:06.112652 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-fa675ebe-c830-44c7-a059-ed0f1af1ba28 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:06.126359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-fa675ebe-c830-44c7-a059-ed0f1af1ba28 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] HTTP exception thrown: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fa675ebe-c830-44c7-a059-ed0f1af1ba28 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Request method failure captured: May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade HTTP/1.1 May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig5LxZbInB7SOHn1-qE9LapGrzhANUH9aSftVQ0EZUjmG7OGwhm_hknpBFmTPtcZvGBzad04sPm_wqmKzTo__buJWhfrbfSMmfnT3MeO5AeG7nS2KrX1OA6anFF7G6lidOz3m8WeugV33Abu_eRl66gd1ygXK2Vhbhid0tqlzFzcsZ0g May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 96b18ec30b804e1e9ac7467a441c919b May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-TestVolumeBootPattern-1872407863 May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:23:06.127996 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96b18ec30b804e1e9ac7467a441c919b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_96b18ec30b804e1e9ac7467a441c919b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/96b18ec30b804e1e9ac7467a441c919b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96b18ec30b804e1e9ac7467a441c919b"}]}] May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-TestVolumeBootPattern-1872407863 May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 96b18ec30b804e1e9ac7467a441c919b May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-TestVolumeBootPattern-1872407863 May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-TestVolumeBootPattern-1872407863-project May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 934f4b8dae3b410ebc6b8c03f47b15a7 May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-TestVolumeBootPattern-1872407863-project May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:23:06.129760 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '4114b620-de69-4409-8d15-45289549bade'} May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:23:06.130649 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:23:06.131973 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:23:06.133219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-fa675ebe-c830-44c7-a059-ed0f1af1ba28 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Returning 404 to user: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:23:06.133219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-fa675ebe-c830-44c7-a059-ed0f1af1ba28 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 404 len: 111 microversion: 2.1 time: 0.030514 May 17 12:23:06.133219 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 565/1142] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:06 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:23:06.176795 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-861017324", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1078707457", "security_groups": [{"name": "tempest-secgroup-smoke-1166071696"}], "block_device_mapping_v2": [{"uuid": "c0581cfb-501f-4e51-b461-882f4d58103d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3d50c84-17ce-4c9f-9999-cbef27efd480"}]}} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:23:06.286365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.network.neutron [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] validate_networks() for [('e3d50c84-17ce-4c9f-9999-cbef27efd480', None, None, None, None, None)] {{(pid=117114) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:23:06.694385 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Flavor limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:23:06.694810 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Image limits 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:23:06.695288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Flavor pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:23:06.695698 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Image pref 0:0:0 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:23:06.696111 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.virt.hardware [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117114) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:23:06.705624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:06.706122 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:06.706925 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:06.707641 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:06.724712 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Getting quotas for project 96b18ec30b804e1e9ac7467a441c919b. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:23:06.728564 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.quota [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Getting quotas for user 934f4b8dae3b410ebc6b8c03f47b15a7 and project 96b18ec30b804e1e9ac7467a441c919b. Resources: {'cores', 'ram', 'instances'} {{(pid=117114) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:23:06.787401 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Going to run 1 instances... {{(pid=117114) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:23:06.789645 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0581cfb-501f-4e51-b461-882f4d58103d',volume_size=None,volume_type=None)] {{(pid=117114) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:23:06.917267 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-524fbec5-9c78-4bd0-920e-96a72033129c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745494 May 17 12:23:06.918140 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 578/1143] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:23:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:23:06.928324 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-cfee9161-f128-4b0f-8784-f1afb0a223aa tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:06.928941 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-cfee9161-f128-4b0f-8784-f1afb0a223aa tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:06.989025 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-cfee9161-f128-4b0f-8784-f1afb0a223aa tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:06.995712 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-cfee9161-f128-4b0f-8784-f1afb0a223aa tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1094 microversion: 2.1 time: 0.071172 May 17 12:23:06.996314 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 566/1144] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:06 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:08.013866 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-1b5eb79d-a4ca-4775-af71-ef227fc8221f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:08.015274 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-1b5eb79d-a4ca-4775-af71-ef227fc8221f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:08.025295 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1b5eb79d-a4ca-4775-af71-ef227fc8221f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:08.026059 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1b5eb79d-a4ca-4775-af71-ef227fc8221f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:08.027024 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1b5eb79d-a4ca-4775-af71-ef227fc8221f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:08.027800 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-1b5eb79d-a4ca-4775-af71-ef227fc8221f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:08.134150 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-1b5eb79d-a4ca-4775-af71-ef227fc8221f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:08.146601 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-1b5eb79d-a4ca-4775-af71-ef227fc8221f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1200 microversion: 2.1 time: 0.136482 May 17 12:23:08.147676 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 579/1145] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:08 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1200 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:09.163976 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b22327fa-bd07-4756-bec6-d082f3f44a9f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:09.164624 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b22327fa-bd07-4756-bec6-d082f3f44a9f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:09.171997 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b22327fa-bd07-4756-bec6-d082f3f44a9f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:09.172516 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b22327fa-bd07-4756-bec6-d082f3f44a9f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:09.173386 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b22327fa-bd07-4756-bec6-d082f3f44a9f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:09.173825 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b22327fa-bd07-4756-bec6-d082f3f44a9f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:09.322954 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-b22327fa-bd07-4756-bec6-d082f3f44a9f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:09.334748 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b22327fa-bd07-4756-bec6-d082f3f44a9f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.174487 May 17 12:23:09.335862 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 567/1146] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:09 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:09.573371 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-403506e9-5e60-46ab-a99f-c32c4c7e4383 req-d52be18b-35c3-4f17-989f-8daba6f4f309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f408b84-5740-49bc-affc-1cb66c5cdf13", "tag": "77b4a31e-bbca-4968-a9c7-13f075b15a4e"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:23:09.586632 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-403506e9-5e60-46ab-a99f-c32c4c7e4383 req-d52be18b-35c3-4f17-989f-8daba6f4f309 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:09.586977 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-403506e9-5e60-46ab-a99f-c32c4c7e4383 req-d52be18b-35c3-4f17-989f-8daba6f4f309 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:09.602687 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-403506e9-5e60-46ab-a99f-c32c4c7e4383 req-d52be18b-35c3-4f17-989f-8daba6f4f309 service nova] Creating event network-changed:77b4a31e-bbca-4968-a9c7-13f075b15a4e for instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 on hv-cinder-83769 May 17 12:23:09.608733 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-403506e9-5e60-46ab-a99f-c32c4c7e4383 req-d52be18b-35c3-4f17-989f-8daba6f4f309 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040962 May 17 12:23:09.609392 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 580/1147] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:23:10.351565 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-2023ca7a-e8ac-4a57-9846-428f15ddf73b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:10.352107 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-2023ca7a-e8ac-4a57-9846-428f15ddf73b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:10.358566 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2023ca7a-e8ac-4a57-9846-428f15ddf73b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:10.359016 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2023ca7a-e8ac-4a57-9846-428f15ddf73b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:10.359775 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2023ca7a-e8ac-4a57-9846-428f15ddf73b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:10.360299 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-2023ca7a-e8ac-4a57-9846-428f15ddf73b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:10.497697 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-2023ca7a-e8ac-4a57-9846-428f15ddf73b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:10.505687 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-2023ca7a-e8ac-4a57-9846-428f15ddf73b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.158106 May 17 12:23:10.506280 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 568/1148] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:10 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:11.523183 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a015aa75-b95f-42aa-b494-8f70bb629f57 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:11.523792 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a015aa75-b95f-42aa-b494-8f70bb629f57 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:11.530338 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a015aa75-b95f-42aa-b494-8f70bb629f57 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:11.530793 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a015aa75-b95f-42aa-b494-8f70bb629f57 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:11.531560 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a015aa75-b95f-42aa-b494-8f70bb629f57 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:11.532516 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a015aa75-b95f-42aa-b494-8f70bb629f57 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:11.661262 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a015aa75-b95f-42aa-b494-8f70bb629f57 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:11.668403 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a015aa75-b95f-42aa-b494-8f70bb629f57 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.149501 May 17 12:23:11.668966 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 581/1149] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:11 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:12.684980 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5d21f01d-dd1b-45bc-b9fd-014a0352019f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:12.685598 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5d21f01d-dd1b-45bc-b9fd-014a0352019f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:12.691918 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5d21f01d-dd1b-45bc-b9fd-014a0352019f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:12.692403 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5d21f01d-dd1b-45bc-b9fd-014a0352019f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:12.693173 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5d21f01d-dd1b-45bc-b9fd-014a0352019f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:12.693610 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5d21f01d-dd1b-45bc-b9fd-014a0352019f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:12.825305 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-5d21f01d-dd1b-45bc-b9fd-014a0352019f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:12.832932 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5d21f01d-dd1b-45bc-b9fd-014a0352019f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.151812 May 17 12:23:12.833520 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 569/1150] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:12 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:13.848731 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2efdbf40-0265-4cd4-b598-66843febe0c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:13.849270 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2efdbf40-0265-4cd4-b598-66843febe0c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:13.855478 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2efdbf40-0265-4cd4-b598-66843febe0c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:13.855923 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2efdbf40-0265-4cd4-b598-66843febe0c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:13.856713 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2efdbf40-0265-4cd4-b598-66843febe0c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:13.857146 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2efdbf40-0265-4cd4-b598-66843febe0c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:13.987336 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-2efdbf40-0265-4cd4-b598-66843febe0c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:13.994533 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2efdbf40-0265-4cd4-b598-66843febe0c7 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.149781 May 17 12:23:13.995091 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 582/1151] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:13 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:14.246666 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:23:14.246888 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Tue May 17 12:23:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:23:15.010705 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-df862d6b-4efe-44d6-906d-0f6ec6eed352 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:15.011346 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-df862d6b-4efe-44d6-906d-0f6ec6eed352 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:15.018392 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-df862d6b-4efe-44d6-906d-0f6ec6eed352 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:15.018842 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-df862d6b-4efe-44d6-906d-0f6ec6eed352 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:15.019606 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-df862d6b-4efe-44d6-906d-0f6ec6eed352 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:15.020038 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-df862d6b-4efe-44d6-906d-0f6ec6eed352 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:15.150212 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-df862d6b-4efe-44d6-906d-0f6ec6eed352 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:15.158160 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-df862d6b-4efe-44d6-906d-0f6ec6eed352 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.151192 May 17 12:23:15.158731 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 570/1152] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:15 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:16.174273 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-538ed251-8571-45c1-a36e-0862e53c3a6c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:16.174888 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-538ed251-8571-45c1-a36e-0862e53c3a6c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:16.181263 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-538ed251-8571-45c1-a36e-0862e53c3a6c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:16.181710 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-538ed251-8571-45c1-a36e-0862e53c3a6c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:16.182473 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-538ed251-8571-45c1-a36e-0862e53c3a6c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:16.182909 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-538ed251-8571-45c1-a36e-0862e53c3a6c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:16.309344 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-538ed251-8571-45c1-a36e-0862e53c3a6c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:16.316582 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-538ed251-8571-45c1-a36e-0862e53c3a6c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.146118 May 17 12:23:16.317151 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 583/1153] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:16 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:17.333970 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-a725e6ad-e9bb-423b-afe6-47c71d05dfc1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:17.334581 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-a725e6ad-e9bb-423b-afe6-47c71d05dfc1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:17.341073 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a725e6ad-e9bb-423b-afe6-47c71d05dfc1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:17.341528 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a725e6ad-e9bb-423b-afe6-47c71d05dfc1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:17.342302 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a725e6ad-e9bb-423b-afe6-47c71d05dfc1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:17.342744 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-a725e6ad-e9bb-423b-afe6-47c71d05dfc1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:17.472127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-a725e6ad-e9bb-423b-afe6-47c71d05dfc1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:17.479803 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-a725e6ad-e9bb-423b-afe6-47c71d05dfc1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.149655 May 17 12:23:17.480441 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 571/1154] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:17 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:18.496722 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f67004ea-1622-430f-a742-62afeca7ee48 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:18.497340 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f67004ea-1622-430f-a742-62afeca7ee48 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:18.503808 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f67004ea-1622-430f-a742-62afeca7ee48 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:18.504288 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f67004ea-1622-430f-a742-62afeca7ee48 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:18.505064 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f67004ea-1622-430f-a742-62afeca7ee48 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:18.505502 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f67004ea-1622-430f-a742-62afeca7ee48 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:18.639981 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f67004ea-1622-430f-a742-62afeca7ee48 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:18.647831 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f67004ea-1622-430f-a742-62afeca7ee48 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.154978 May 17 12:23:18.648447 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 584/1155] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:18 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:19.664943 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-4a40f4c3-ff0c-4014-897a-80affb441e46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:19.665533 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-4a40f4c3-ff0c-4014-897a-80affb441e46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:19.671890 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4a40f4c3-ff0c-4014-897a-80affb441e46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:19.673140 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4a40f4c3-ff0c-4014-897a-80affb441e46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:19.673916 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4a40f4c3-ff0c-4014-897a-80affb441e46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:19.674350 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-4a40f4c3-ff0c-4014-897a-80affb441e46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:19.815599 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-4a40f4c3-ff0c-4014-897a-80affb441e46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:19.822962 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-4a40f4c3-ff0c-4014-897a-80affb441e46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.161840 May 17 12:23:19.823538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 572/1156] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:19 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:20.289880 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-9ece63e8-8b8e-4c40-9bdd-456ff19d1914 req-912040f0-6855-4ac7-9ce5-374df1ec289e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f408b84-5740-49bc-affc-1cb66c5cdf13", "name": "network-vif-plugged", "status": "completed", "tag": "77b4a31e-bbca-4968-a9c7-13f075b15a4e"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:23:20.298500 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-9ece63e8-8b8e-4c40-9bdd-456ff19d1914 req-912040f0-6855-4ac7-9ce5-374df1ec289e service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:20.298944 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-9ece63e8-8b8e-4c40-9bdd-456ff19d1914 req-912040f0-6855-4ac7-9ce5-374df1ec289e service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:20.309833 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-9ece63e8-8b8e-4c40-9bdd-456ff19d1914 req-912040f0-6855-4ac7-9ce5-374df1ec289e service nova] Creating event network-vif-plugged:77b4a31e-bbca-4968-a9c7-13f075b15a4e for instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 on hv-cinder-83769 May 17 12:23:20.315286 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-9ece63e8-8b8e-4c40-9bdd-456ff19d1914 req-912040f0-6855-4ac7-9ce5-374df1ec289e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086271 May 17 12:23:20.315907 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 585/1157] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:23:20.840303 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e619fdad-a65a-4c17-bb04-9de1f7032787 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:20.840839 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e619fdad-a65a-4c17-bb04-9de1f7032787 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:20.847268 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e619fdad-a65a-4c17-bb04-9de1f7032787 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:20.847720 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e619fdad-a65a-4c17-bb04-9de1f7032787 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:20.848505 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e619fdad-a65a-4c17-bb04-9de1f7032787 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:20.848942 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e619fdad-a65a-4c17-bb04-9de1f7032787 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:20.977033 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-e619fdad-a65a-4c17-bb04-9de1f7032787 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:20.984320 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e619fdad-a65a-4c17-bb04-9de1f7032787 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1266 microversion: 2.1 time: 0.147942 May 17 12:23:20.985703 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 573/1158] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:20 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:22.002728 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-0d98ffac-3e64-4b8c-a1a3-2dcc5dafd16e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:22.003419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-0d98ffac-3e64-4b8c-a1a3-2dcc5dafd16e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:22.009491 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d98ffac-3e64-4b8c-a1a3-2dcc5dafd16e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:22.009935 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d98ffac-3e64-4b8c-a1a3-2dcc5dafd16e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:22.010696 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d98ffac-3e64-4b8c-a1a3-2dcc5dafd16e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:22.011131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-0d98ffac-3e64-4b8c-a1a3-2dcc5dafd16e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:22.138443 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-0d98ffac-3e64-4b8c-a1a3-2dcc5dafd16e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:22.146206 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-0d98ffac-3e64-4b8c-a1a3-2dcc5dafd16e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1453 microversion: 2.1 time: 0.148247 May 17 12:23:22.146794 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 586/1159] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:21 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:22.162442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c31e9d86-1f8f-4cd6-a24e-03c4f36446c4 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:23:22.163050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c31e9d86-1f8f-4cd6-a24e-03c4f36446c4 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:23:22.169494 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c31e9d86-1f8f-4cd6-a24e-03c4f36446c4 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:22.169942 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c31e9d86-1f8f-4cd6-a24e-03c4f36446c4 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:22.170710 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c31e9d86-1f8f-4cd6-a24e-03c4f36446c4 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:22.171140 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c31e9d86-1f8f-4cd6-a24e-03c4f36446c4 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:22.298915 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c31e9d86-1f8f-4cd6-a24e-03c4f36446c4 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:23:22.306214 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c31e9d86-1f8f-4cd6-a24e-03c4f36446c4 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1453 microversion: 2.1 time: 0.147565 May 17 12:23:22.306792 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 574/1160] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:23:22 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:23:24.115552 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-c8cb9dcb-8773-43cc-a3ba-d01e0e08042e req-5140e89e-5ddd-474e-b831-0b8085dba38f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f408b84-5740-49bc-affc-1cb66c5cdf13", "tag": "77b4a31e-bbca-4968-a9c7-13f075b15a4e"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:23:24.123730 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-c8cb9dcb-8773-43cc-a3ba-d01e0e08042e req-5140e89e-5ddd-474e-b831-0b8085dba38f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:23:24.124168 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-c8cb9dcb-8773-43cc-a3ba-d01e0e08042e req-5140e89e-5ddd-474e-b831-0b8085dba38f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:23:24.135501 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-c8cb9dcb-8773-43cc-a3ba-d01e0e08042e req-5140e89e-5ddd-474e-b831-0b8085dba38f service nova] Creating event network-changed:77b4a31e-bbca-4968-a9c7-13f075b15a4e for instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 on hv-cinder-83769 May 17 12:23:24.140421 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-c8cb9dcb-8773-43cc-a3ba-d01e0e08042e req-5140e89e-5ddd-474e-b831-0b8085dba38f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028511 May 17 12:23:24.141534 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 587/1161] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:23:37.695696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:23:37.696270 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Tue May 17 12:23:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:24:49.993816 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:24:49.994589 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Tue May 17 12:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:25:26.560044 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1676330433", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1078707457", "security_groups": [{"name": "tempest-secgroup-smoke-1166071696"}], "block_device_mapping_v2": [{"uuid": "83712ee9-f9cb-436e-b271-eb503d51b09a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3d50c84-17ce-4c9f-9999-cbef27efd480"}]}} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:25:26.672312 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.network.neutron [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] validate_networks() for [('e3d50c84-17ce-4c9f-9999-cbef27efd480', None, None, None, None, None)] {{(pid=117113) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 12:25:27.036810 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Flavor limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 12:25:27.037239 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Image limits 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 12:25:27.037717 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Flavor pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 12:25:27.038132 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Image pref 0:0:0 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 12:25:27.038546 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.virt.hardware [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 12:25:27.047543 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:27.047990 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:27.048836 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:27.049271 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:27.065880 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Getting quotas for project 96b18ec30b804e1e9ac7467a441c919b. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 12:25:27.069751 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.quota [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Getting quotas for user 934f4b8dae3b410ebc6b8c03f47b15a7 and project 96b18ec30b804e1e9ac7467a441c919b. Resources: {'cores', 'ram', 'instances'} {{(pid=117113) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 12:25:27.130037 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Going to run 1 instances... {{(pid=117113) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 12:25:27.132170 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='83712ee9-f9cb-436e-b271-eb503d51b09a',volume_size=None,volume_type=None)] {{(pid=117113) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 12:25:27.256596 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [815d4ea5-6689-482d-80ac-09165ba57359] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 12:25:28.263899 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO oslo.messaging._drivers.impl_rabbit [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [815d4ea5-6689-482d-80ac-09165ba57359] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60232. May 17 12:25:28.268467 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-b8d1c1cb-b254-49a8-8500-944552727bac tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.713300 May 17 12:25:28.269127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 575/1162] 10.222.0.58 () {60 vars in 1146 bytes} [Tue May 17 12:25:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 12:25:28.280349 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-de3331b2-e329-43a8-8a69-c7a2249d2e56 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:28.281964 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-de3331b2-e329-43a8-8a69-c7a2249d2e56 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:28.334984 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-de3331b2-e329-43a8-8a69-c7a2249d2e56 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:28.341448 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-de3331b2-e329-43a8-8a69-c7a2249d2e56 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1095 microversion: 2.1 time: 0.066068 May 17 12:25:28.342010 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 588/1163] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:28 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:29.359521 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-59190dbc-f55c-458e-ae24-e441c3a4af46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:29.360241 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-59190dbc-f55c-458e-ae24-e441c3a4af46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:29.413248 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-59190dbc-f55c-458e-ae24-e441c3a4af46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:29.419749 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-59190dbc-f55c-458e-ae24-e441c3a4af46 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1095 microversion: 2.1 time: 0.065073 May 17 12:25:29.420342 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 576/1164] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:29 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:30.436843 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-e2d3288f-1b50-4359-966d-6e3001d00c44 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:30.437897 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-e2d3288f-1b50-4359-966d-6e3001d00c44 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:30.494216 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-e2d3288f-1b50-4359-966d-6e3001d00c44 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:30.500994 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-e2d3288f-1b50-4359-966d-6e3001d00c44 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1095 microversion: 2.1 time: 0.067886 May 17 12:25:30.501554 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 589/1165] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:30 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:31.518174 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-24374591-f58b-44cf-8749-abef75ad6289 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:31.518798 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-24374591-f58b-44cf-8749-abef75ad6289 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:31.571778 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-24374591-f58b-44cf-8749-abef75ad6289 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:31.579289 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-24374591-f58b-44cf-8749-abef75ad6289 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1095 microversion: 2.1 time: 0.065533 May 17 12:25:31.579870 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 577/1166] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:31 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:32.596480 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-4f11b8a8-bd90-42c6-bbb4-ff61ef7f435b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:32.597095 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-4f11b8a8-bd90-42c6-bbb4-ff61ef7f435b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:32.603597 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f11b8a8-bd90-42c6-bbb4-ff61ef7f435b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:32.604040 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f11b8a8-bd90-42c6-bbb4-ff61ef7f435b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:32.604836 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f11b8a8-bd90-42c6-bbb4-ff61ef7f435b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:32.605270 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-4f11b8a8-bd90-42c6-bbb4-ff61ef7f435b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:32.666465 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-4f11b8a8-bd90-42c6-bbb4-ff61ef7f435b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:32.674462 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-4f11b8a8-bd90-42c6-bbb4-ff61ef7f435b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1145 microversion: 2.1 time: 0.082334 May 17 12:25:32.675109 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 590/1167] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:32 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:33.691704 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-30d504c2-93b0-48e0-a914-97207f36e850 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:33.692345 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-30d504c2-93b0-48e0-a914-97207f36e850 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:33.698743 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-30d504c2-93b0-48e0-a914-97207f36e850 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:33.699267 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-30d504c2-93b0-48e0-a914-97207f36e850 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:33.700103 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-30d504c2-93b0-48e0-a914-97207f36e850 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:33.700685 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-30d504c2-93b0-48e0-a914-97207f36e850 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:33.766119 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-30d504c2-93b0-48e0-a914-97207f36e850 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:33.774277 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-30d504c2-93b0-48e0-a914-97207f36e850 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1211 microversion: 2.1 time: 0.086527 May 17 12:25:33.774887 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 578/1168] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:33 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:34.639365 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-91445d6d-dbe7-4158-8cdd-259655b081da req-d5625edd-9dfc-430b-931b-d2ae3461a95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b095e940-8a32-4143-822d-2036c21cde20", "tag": "5bf8e2f7-3b62-4b78-b630-b9ee06e91459"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:25:34.651035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-91445d6d-dbe7-4158-8cdd-259655b081da req-d5625edd-9dfc-430b-931b-d2ae3461a95e service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:34.651695 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-91445d6d-dbe7-4158-8cdd-259655b081da req-d5625edd-9dfc-430b-931b-d2ae3461a95e service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:34.664520 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-91445d6d-dbe7-4158-8cdd-259655b081da req-d5625edd-9dfc-430b-931b-d2ae3461a95e service nova] Creating event network-changed:5bf8e2f7-3b62-4b78-b630-b9ee06e91459 for instance b095e940-8a32-4143-822d-2036c21cde20 on hv-cinder-83769 May 17 12:25:34.669470 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-91445d6d-dbe7-4158-8cdd-259655b081da req-d5625edd-9dfc-430b-931b-d2ae3461a95e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034424 May 17 12:25:34.670007 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 591/1169] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:25:34.791898 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-c44fc0f1-9fc7-4238-9c73-d4307c82b0fe tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:34.792554 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-c44fc0f1-9fc7-4238-9c73-d4307c82b0fe tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:34.799807 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c44fc0f1-9fc7-4238-9c73-d4307c82b0fe tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:34.800501 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c44fc0f1-9fc7-4238-9c73-d4307c82b0fe tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:34.801293 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c44fc0f1-9fc7-4238-9c73-d4307c82b0fe tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:34.801741 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-c44fc0f1-9fc7-4238-9c73-d4307c82b0fe tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:34.932744 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-c44fc0f1-9fc7-4238-9c73-d4307c82b0fe tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:34.940843 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-c44fc0f1-9fc7-4238-9c73-d4307c82b0fe tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.152746 May 17 12:25:34.941422 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 579/1170] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:34 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:35.959486 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-a237a60a-8383-4632-ba06-007fec9d0103 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:35.960231 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-a237a60a-8383-4632-ba06-007fec9d0103 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:35.966419 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a237a60a-8383-4632-ba06-007fec9d0103 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:35.966861 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a237a60a-8383-4632-ba06-007fec9d0103 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:35.967623 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a237a60a-8383-4632-ba06-007fec9d0103 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:35.968056 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-a237a60a-8383-4632-ba06-007fec9d0103 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:36.179255 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-a237a60a-8383-4632-ba06-007fec9d0103 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:36.186544 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-a237a60a-8383-4632-ba06-007fec9d0103 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.231761 May 17 12:25:36.187757 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 592/1171] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:35 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:25:37.204837 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-0aeb6ebf-3301-4a15-914d-b24d189347c1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:37.205394 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-0aeb6ebf-3301-4a15-914d-b24d189347c1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:37.211613 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0aeb6ebf-3301-4a15-914d-b24d189347c1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:37.212065 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0aeb6ebf-3301-4a15-914d-b24d189347c1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:37.212892 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0aeb6ebf-3301-4a15-914d-b24d189347c1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:37.213360 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-0aeb6ebf-3301-4a15-914d-b24d189347c1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:37.338757 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-0aeb6ebf-3301-4a15-914d-b24d189347c1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:37.346981 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-0aeb6ebf-3301-4a15-914d-b24d189347c1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.147030 May 17 12:25:37.347557 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 580/1172] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:37 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:38.365279 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-071c3c69-b28a-4e17-a2ab-68b876cf5479 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:38.365892 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-071c3c69-b28a-4e17-a2ab-68b876cf5479 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:38.372170 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-071c3c69-b28a-4e17-a2ab-68b876cf5479 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:38.372705 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-071c3c69-b28a-4e17-a2ab-68b876cf5479 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:38.373468 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-071c3c69-b28a-4e17-a2ab-68b876cf5479 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:38.373901 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-071c3c69-b28a-4e17-a2ab-68b876cf5479 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:38.501572 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-071c3c69-b28a-4e17-a2ab-68b876cf5479 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:38.509732 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-071c3c69-b28a-4e17-a2ab-68b876cf5479 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.150750 May 17 12:25:38.510304 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 593/1173] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:38 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:39.526592 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-052fb6c8-e943-4e83-a0d7-d09ab036a925 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:39.527213 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-052fb6c8-e943-4e83-a0d7-d09ab036a925 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:39.533806 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-052fb6c8-e943-4e83-a0d7-d09ab036a925 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:39.534255 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-052fb6c8-e943-4e83-a0d7-d09ab036a925 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:39.535156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-052fb6c8-e943-4e83-a0d7-d09ab036a925 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:39.535590 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-052fb6c8-e943-4e83-a0d7-d09ab036a925 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:39.667145 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-052fb6c8-e943-4e83-a0d7-d09ab036a925 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:39.674358 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-052fb6c8-e943-4e83-a0d7-d09ab036a925 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.151652 May 17 12:25:39.674926 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 581/1174] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:39 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:40.691465 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b11e9293-476b-4b87-a4da-1382f2c133ad tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:40.692071 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b11e9293-476b-4b87-a4da-1382f2c133ad tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:40.698392 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b11e9293-476b-4b87-a4da-1382f2c133ad tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:40.698838 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b11e9293-476b-4b87-a4da-1382f2c133ad tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:40.699595 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b11e9293-476b-4b87-a4da-1382f2c133ad tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:40.700057 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b11e9293-476b-4b87-a4da-1382f2c133ad tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:40.829360 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b11e9293-476b-4b87-a4da-1382f2c133ad tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:40.836467 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b11e9293-476b-4b87-a4da-1382f2c133ad tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.149435 May 17 12:25:40.837057 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 594/1175] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:40 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:41.852988 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-bc0ab261-cd72-41cb-a671-02e77c208c7f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:41.853564 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-bc0ab261-cd72-41cb-a671-02e77c208c7f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:41.860395 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc0ab261-cd72-41cb-a671-02e77c208c7f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:41.860839 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc0ab261-cd72-41cb-a671-02e77c208c7f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:41.861599 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc0ab261-cd72-41cb-a671-02e77c208c7f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:41.862029 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-bc0ab261-cd72-41cb-a671-02e77c208c7f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:41.987976 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-bc0ab261-cd72-41cb-a671-02e77c208c7f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:41.995419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-bc0ab261-cd72-41cb-a671-02e77c208c7f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.146386 May 17 12:25:41.995995 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 582/1176] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:41 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:43.011882 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-62911afb-7ddf-4028-92bd-9c137ef0c62b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:43.012536 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-62911afb-7ddf-4028-92bd-9c137ef0c62b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:43.019499 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62911afb-7ddf-4028-92bd-9c137ef0c62b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:43.019949 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62911afb-7ddf-4028-92bd-9c137ef0c62b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:43.020753 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62911afb-7ddf-4028-92bd-9c137ef0c62b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:43.021189 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-62911afb-7ddf-4028-92bd-9c137ef0c62b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:43.158256 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-62911afb-7ddf-4028-92bd-9c137ef0c62b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:43.165616 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-62911afb-7ddf-4028-92bd-9c137ef0c62b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.157574 May 17 12:25:43.166178 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 595/1177] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:43 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:44.182338 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-deb94e43-5b4b-471a-95e1-efc9bf001fe8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:44.182949 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-deb94e43-5b4b-471a-95e1-efc9bf001fe8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:44.189358 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-deb94e43-5b4b-471a-95e1-efc9bf001fe8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:44.189801 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-deb94e43-5b4b-471a-95e1-efc9bf001fe8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:44.190560 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-deb94e43-5b4b-471a-95e1-efc9bf001fe8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:44.190994 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-deb94e43-5b4b-471a-95e1-efc9bf001fe8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:44.315579 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-deb94e43-5b4b-471a-95e1-efc9bf001fe8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:44.323033 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-deb94e43-5b4b-471a-95e1-efc9bf001fe8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.144521 May 17 12:25:44.324026 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 583/1178] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:44 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:45.341202 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-b88e2573-4391-462c-9693-9decc5f65b49 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:45.341816 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-b88e2573-4391-462c-9693-9decc5f65b49 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:45.348803 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b88e2573-4391-462c-9693-9decc5f65b49 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:45.349251 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b88e2573-4391-462c-9693-9decc5f65b49 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:45.350009 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b88e2573-4391-462c-9693-9decc5f65b49 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:45.350440 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-b88e2573-4391-462c-9693-9decc5f65b49 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:45.479680 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-b88e2573-4391-462c-9693-9decc5f65b49 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:45.487877 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-b88e2573-4391-462c-9693-9decc5f65b49 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.151318 May 17 12:25:45.489131 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 596/1179] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:45 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:46.505165 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-62102e3c-3cf4-4492-ac3d-0f9111e2fda8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:46.505795 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-62102e3c-3cf4-4492-ac3d-0f9111e2fda8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:46.512121 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-62102e3c-3cf4-4492-ac3d-0f9111e2fda8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:46.512607 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-62102e3c-3cf4-4492-ac3d-0f9111e2fda8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:46.513375 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-62102e3c-3cf4-4492-ac3d-0f9111e2fda8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:46.513811 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-62102e3c-3cf4-4492-ac3d-0f9111e2fda8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:46.647167 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-62102e3c-3cf4-4492-ac3d-0f9111e2fda8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:46.654459 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-62102e3c-3cf4-4492-ac3d-0f9111e2fda8 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.153190 May 17 12:25:46.655023 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 584/1180] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:46 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:47.002564 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [req-2cf65149-3ae5-4724-9fba-2dbc0e457133 req-4da0fe7e-5796-4333-ba69-518298d2580f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b095e940-8a32-4143-822d-2036c21cde20", "name": "network-vif-plugged", "status": "completed", "tag": "5bf8e2f7-3b62-4b78-b630-b9ee06e91459"}]} {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:25:47.011369 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-2cf65149-3ae5-4724-9fba-2dbc0e457133 req-4da0fe7e-5796-4333-ba69-518298d2580f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:47.011878 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [req-2cf65149-3ae5-4724-9fba-2dbc0e457133 req-4da0fe7e-5796-4333-ba69-518298d2580f service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:47.024495 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.compute.server_external_events [req-2cf65149-3ae5-4724-9fba-2dbc0e457133 req-4da0fe7e-5796-4333-ba69-518298d2580f service nova] Creating event network-vif-plugged:5bf8e2f7-3b62-4b78-b630-b9ee06e91459 for instance b095e940-8a32-4143-822d-2036c21cde20 on hv-cinder-83769 May 17 12:25:47.029531 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [req-2cf65149-3ae5-4724-9fba-2dbc0e457133 req-4da0fe7e-5796-4333-ba69-518298d2580f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031217 May 17 12:25:47.030616 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 597/1181] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:25:47.672213 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-d922ab08-a1bf-4691-996a-4d28d3e7f179 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:47.672871 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-d922ab08-a1bf-4691-996a-4d28d3e7f179 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:47.679223 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d922ab08-a1bf-4691-996a-4d28d3e7f179 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:47.679676 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d922ab08-a1bf-4691-996a-4d28d3e7f179 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:47.680480 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d922ab08-a1bf-4691-996a-4d28d3e7f179 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:47.680921 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-d922ab08-a1bf-4691-996a-4d28d3e7f179 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:47.809468 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-d922ab08-a1bf-4691-996a-4d28d3e7f179 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:47.816788 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-d922ab08-a1bf-4691-996a-4d28d3e7f179 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.149040 May 17 12:25:47.817362 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 585/1182] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:47 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:48.835035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-bbb813ab-9268-484d-bf74-3d387503b00c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:48.835691 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-bbb813ab-9268-484d-bf74-3d387503b00c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:48.842083 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bbb813ab-9268-484d-bf74-3d387503b00c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:48.842540 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bbb813ab-9268-484d-bf74-3d387503b00c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:48.843324 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bbb813ab-9268-484d-bf74-3d387503b00c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:48.843806 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-bbb813ab-9268-484d-bf74-3d387503b00c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:48.977667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-bbb813ab-9268-484d-bf74-3d387503b00c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:48.985667 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-bbb813ab-9268-484d-bf74-3d387503b00c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1267 microversion: 2.1 time: 0.156135 May 17 12:25:48.986227 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 598/1183] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:48 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:50.004514 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-8fddf8ad-0183-4359-aab8-69bbc7eadfa9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:50.005147 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-8fddf8ad-0183-4359-aab8-69bbc7eadfa9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:50.014538 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8fddf8ad-0183-4359-aab8-69bbc7eadfa9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:50.015690 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8fddf8ad-0183-4359-aab8-69bbc7eadfa9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:50.016497 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8fddf8ad-0183-4359-aab8-69bbc7eadfa9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:50.016939 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-8fddf8ad-0183-4359-aab8-69bbc7eadfa9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:50.165729 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-8fddf8ad-0183-4359-aab8-69bbc7eadfa9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:50.174080 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-8fddf8ad-0183-4359-aab8-69bbc7eadfa9 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1453 microversion: 2.1 time: 0.175299 May 17 12:25:50.174660 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 586/1184] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:49 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:50.193649 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-f21becc0-40c9-4673-8728-309ed3680879 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:25:50.194776 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-f21becc0-40c9-4673-8728-309ed3680879 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:25:50.202699 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f21becc0-40c9-4673-8728-309ed3680879 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:50.203315 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f21becc0-40c9-4673-8728-309ed3680879 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:50.204091 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f21becc0-40c9-4673-8728-309ed3680879 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:50.204561 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-f21becc0-40c9-4673-8728-309ed3680879 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:50.337209 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-f21becc0-40c9-4673-8728-309ed3680879 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:25:50.344879 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-f21becc0-40c9-4673-8728-309ed3680879 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1453 microversion: 2.1 time: 0.158270 May 17 12:25:50.345449 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 599/1185] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:25:50 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:25:52.236442 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-e368a4b7-d740-4232-b0fa-fac1b1885151 req-631fa2eb-22b4-457b-8055-714c998c8ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b095e940-8a32-4143-822d-2036c21cde20", "tag": "5bf8e2f7-3b62-4b78-b630-b9ee06e91459"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:25:52.244824 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-e368a4b7-d740-4232-b0fa-fac1b1885151 req-631fa2eb-22b4-457b-8055-714c998c8ed8 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:25:52.245272 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-e368a4b7-d740-4232-b0fa-fac1b1885151 req-631fa2eb-22b4-457b-8055-714c998c8ed8 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:25:52.257067 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-e368a4b7-d740-4232-b0fa-fac1b1885151 req-631fa2eb-22b4-457b-8055-714c998c8ed8 service nova] Creating event network-changed:5bf8e2f7-3b62-4b78-b630-b9ee06e91459 for instance b095e940-8a32-4143-822d-2036c21cde20 on hv-cinder-83769 May 17 12:25:52.264144 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-e368a4b7-d740-4232-b0fa-fac1b1885151 req-631fa2eb-22b4-457b-8055-714c998c8ed8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031698 May 17 12:25:52.265413 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 587/1186] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 12:26:34.255061 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:26:34.255681 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Tue May 17 12:26:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:27:42.103058 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR oslo.messaging._drivers.impl_rabbit [-] [85a6ddbe-2911-46dc-89b1-d719a592b8cb] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 17 12:27:42.103791 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-5aaa8a54-67d6-44d0-a454-127e584b0745 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:42.104313 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5aaa8a54-67d6-44d0-a454-127e584b0745 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:42.107587 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-081d0ad8-3c1c-4b5e-bdd9-cd63a1c59ac3 req-4311fa1d-f396-423a-863c-78023db3ce26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b095e940-8a32-4143-822d-2036c21cde20", "tag": "5bf8e2f7-3b62-4b78-b630-b9ee06e91459"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:27:42.110466 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5aaa8a54-67d6-44d0-a454-127e584b0745 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:42.110971 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5aaa8a54-67d6-44d0-a454-127e584b0745 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:42.111683 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5aaa8a54-67d6-44d0-a454-127e584b0745 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:42.112389 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-5aaa8a54-67d6-44d0-a454-127e584b0745 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:42.117042 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-081d0ad8-3c1c-4b5e-bdd9-cd63a1c59ac3 req-4311fa1d-f396-423a-863c-78023db3ce26 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:42.117042 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-081d0ad8-3c1c-4b5e-bdd9-cd63a1c59ac3 req-4311fa1d-f396-423a-863c-78023db3ce26 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:42.128232 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-081d0ad8-3c1c-4b5e-bdd9-cd63a1c59ac3 req-4311fa1d-f396-423a-863c-78023db3ce26 service nova] Creating event network-changed:5bf8e2f7-3b62-4b78-b630-b9ee06e91459 for instance b095e940-8a32-4143-822d-2036c21cde20 on hv-cinder-83769 May 17 12:27:42.133640 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-081d0ad8-3c1c-4b5e-bdd9-cd63a1c59ac3 req-4311fa1d-f396-423a-863c-78023db3ce26 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032628 May 17 12:27:42.134527 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 588/1187] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:27:42.140476 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-5aaa8a54-67d6-44d0-a454-127e584b0745 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:27:42.223751 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-5aaa8a54-67d6-44d0-a454-127e584b0745 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 204 len: 0 microversion: 2.1 time: 0.125145 May 17 12:27:42.227577 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 600/1188] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:27:42 2022] DELETE /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:27:42.235243 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-be2abcd4-ab39-4e33-a515-676a70575940 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:42.236065 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-be2abcd4-ab39-4e33-a515-676a70575940 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:42.242448 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-be2abcd4-ab39-4e33-a515-676a70575940 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:42.242986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-be2abcd4-ab39-4e33-a515-676a70575940 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:42.243841 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-be2abcd4-ab39-4e33-a515-676a70575940 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:42.244393 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-be2abcd4-ab39-4e33-a515-676a70575940 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:42.377811 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-be2abcd4-ab39-4e33-a515-676a70575940 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:27:42.385233 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-be2abcd4-ab39-4e33-a515-676a70575940 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1578 microversion: 2.1 time: 0.155744 May 17 12:27:42.385798 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 589/1189] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:27:42 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 12:27:43.403614 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-6881c4cc-3a8b-44f7-8e31-a7560bb45a5e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:43.404364 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-6881c4cc-3a8b-44f7-8e31-a7560bb45a5e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:43.410978 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6881c4cc-3a8b-44f7-8e31-a7560bb45a5e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:43.411438 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6881c4cc-3a8b-44f7-8e31-a7560bb45a5e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:43.412239 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6881c4cc-3a8b-44f7-8e31-a7560bb45a5e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:43.412686 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-6881c4cc-3a8b-44f7-8e31-a7560bb45a5e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:43.828120 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-6881c4cc-3a8b-44f7-8e31-a7560bb45a5e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:27:43.835958 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-6881c4cc-3a8b-44f7-8e31-a7560bb45a5e tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1578 microversion: 2.1 time: 0.436789 May 17 12:27:43.836583 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 601/1190] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:27:43 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1578 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:27:44.571184 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO oslo.messaging._drivers.impl_rabbit [-] [85a6ddbe-2911-46dc-89b1-d719a592b8cb] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60352. May 17 12:27:44.624974 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-cc0facea-4319-4cc7-9a84-32a6f7d290be req-a423d2b3-8d79-41e3-b051-ee5b70890f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b095e940-8a32-4143-822d-2036c21cde20", "name": "network-vif-deleted", "tag": "5bf8e2f7-3b62-4b78-b630-b9ee06e91459"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:27:44.632979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-cc0facea-4319-4cc7-9a84-32a6f7d290be req-a423d2b3-8d79-41e3-b051-ee5b70890f95 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:44.633434 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-cc0facea-4319-4cc7-9a84-32a6f7d290be req-a423d2b3-8d79-41e3-b051-ee5b70890f95 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:44.645839 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-cc0facea-4319-4cc7-9a84-32a6f7d290be req-a423d2b3-8d79-41e3-b051-ee5b70890f95 service nova] Creating event network-vif-deleted:5bf8e2f7-3b62-4b78-b630-b9ee06e91459 for instance b095e940-8a32-4143-822d-2036c21cde20 on hv-cinder-83769 May 17 12:27:44.650741 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-cc0facea-4319-4cc7-9a84-32a6f7d290be req-a423d2b3-8d79-41e3-b051-ee5b70890f95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092532 May 17 12:27:44.651317 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 590/1191] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:27:44.853473 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-aaf5176c-f085-44ec-ad5e-67599ec5136b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:44.854247 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-aaf5176c-f085-44ec-ad5e-67599ec5136b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:44.861311 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aaf5176c-f085-44ec-ad5e-67599ec5136b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:44.861759 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aaf5176c-f085-44ec-ad5e-67599ec5136b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:44.868114 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aaf5176c-f085-44ec-ad5e-67599ec5136b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:44.868114 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-aaf5176c-f085-44ec-ad5e-67599ec5136b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:44.928304 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-aaf5176c-f085-44ec-ad5e-67599ec5136b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:27:44.936926 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-aaf5176c-f085-44ec-ad5e-67599ec5136b tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 200 len: 1226 microversion: 2.1 time: 0.087233 May 17 12:27:44.940305 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 602/1192] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:27:44 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:27:45.954738 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-db9f6e72-0f79-4db8-9ca7-99f6aabd60f6 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:45.955438 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-db9f6e72-0f79-4db8-9ca7-99f6aabd60f6 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: b095e940-8a32-4143-822d-2036c21cde20] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:45.961979 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db9f6e72-0f79-4db8-9ca7-99f6aabd60f6 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:45.962425 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db9f6e72-0f79-4db8-9ca7-99f6aabd60f6 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:45.963182 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db9f6e72-0f79-4db8-9ca7-99f6aabd60f6 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:45.963615 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-db9f6e72-0f79-4db8-9ca7-99f6aabd60f6 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:45.981333 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-db9f6e72-0f79-4db8-9ca7-99f6aabd60f6 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] HTTP exception thrown: Instance b095e940-8a32-4143-822d-2036c21cde20 could not be found. May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-db9f6e72-0f79-4db8-9ca7-99f6aabd60f6 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Request method failure captured: May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 HTTP/1.1 May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig5LxZbInB7SOHn1-qE9LapGrzhANUH9aSftVQ0EZUjmG7OGwhm_hknpBFmTPtcZvGBzad04sPm_wqmKzTo__buJWhfrbfSMmfnT3MeO5AeG7nS2KrX1OA6anFF7G6lidOz3m8WeugV33Abu_eRl66gd1ygXK2Vhbhid0tqlzFzcsZ0g May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 96b18ec30b804e1e9ac7467a441c919b May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:27:45.982969 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96b18ec30b804e1e9ac7467a441c919b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_96b18ec30b804e1e9ac7467a441c919b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/96b18ec30b804e1e9ac7467a441c919b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96b18ec30b804e1e9ac7467a441c919b"}]}] May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 96b18ec30b804e1e9ac7467a441c919b May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-TestVolumeBootPattern-1872407863-project May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 934f4b8dae3b410ebc6b8c03f47b15a7 May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-TestVolumeBootPattern-1872407863-project May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance b095e940-8a32-4143-822d-2036c21cde20 could not be found. May 17 12:27:45.984793 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': 'b095e940-8a32-4143-822d-2036c21cde20'} May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b095e940-8a32-4143-822d-2036c21cde20 could not be found. May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:27:45.985774 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b095e940-8a32-4143-822d-2036c21cde20 could not be found. May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b095e940-8a32-4143-822d-2036c21cde20 could not be found. May 17 12:27:45.987525 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:45.989055 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-db9f6e72-0f79-4db8-9ca7-99f6aabd60f6 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Returning 404 to user: Instance b095e940-8a32-4143-822d-2036c21cde20 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:27:45.989055 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-db9f6e72-0f79-4db8-9ca7-99f6aabd60f6 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20" status: 404 len: 111 microversion: 2.1 time: 0.034659 May 17 12:27:45.989055 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 591/1193] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:27:45 2022] GET /compute/v2.1/servers/b095e940-8a32-4143-822d-2036c21cde20 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:27:49.008557 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-03872870-c658-453b-b8d1-e091c78abc50 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:49.009057 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-03872870-c658-453b-b8d1-e091c78abc50 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:49.010964 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-d511d9ac-279f-43a3-8ef1-702f8cb36403 req-0fdbf046-37b4-4305-8e2e-756e63ad2f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f408b84-5740-49bc-affc-1cb66c5cdf13", "tag": "77b4a31e-bbca-4968-a9c7-13f075b15a4e"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:27:49.015804 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-03872870-c658-453b-b8d1-e091c78abc50 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:49.016769 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-03872870-c658-453b-b8d1-e091c78abc50 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:49.017724 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-03872870-c658-453b-b8d1-e091c78abc50 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:49.018496 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-03872870-c658-453b-b8d1-e091c78abc50 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:49.020640 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-d511d9ac-279f-43a3-8ef1-702f8cb36403 req-0fdbf046-37b4-4305-8e2e-756e63ad2f90 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:49.020988 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-d511d9ac-279f-43a3-8ef1-702f8cb36403 req-0fdbf046-37b4-4305-8e2e-756e63ad2f90 service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:49.034371 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-d511d9ac-279f-43a3-8ef1-702f8cb36403 req-0fdbf046-37b4-4305-8e2e-756e63ad2f90 service nova] Creating event network-changed:77b4a31e-bbca-4968-a9c7-13f075b15a4e for instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 on hv-cinder-83769 May 17 12:27:49.039526 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-d511d9ac-279f-43a3-8ef1-702f8cb36403 req-0fdbf046-37b4-4305-8e2e-756e63ad2f90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032155 May 17 12:27:49.040131 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 592/1194] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:27:49.046943 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-03872870-c658-453b-b8d1-e091c78abc50 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Going to try to terminate instance {{(pid=117114) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 12:27:49.132920 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-03872870-c658-453b-b8d1-e091c78abc50 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 204 len: 0 microversion: 2.1 time: 0.127817 May 17 12:27:49.137823 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 603/1195] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:27:49 2022] DELETE /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 12:27:49.144584 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-60f0ea2c-7fa7-469d-b105-a15de328f93a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:49.145419 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-60f0ea2c-7fa7-469d-b105-a15de328f93a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:49.152052 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-60f0ea2c-7fa7-469d-b105-a15de328f93a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:49.152613 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-60f0ea2c-7fa7-469d-b105-a15de328f93a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:49.154007 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-60f0ea2c-7fa7-469d-b105-a15de328f93a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:49.154504 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-60f0ea2c-7fa7-469d-b105-a15de328f93a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:49.288599 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.policy [None req-60f0ea2c-7fa7-469d-b105-a15de328f93a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117113) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:27:49.297031 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-60f0ea2c-7fa7-469d-b105-a15de328f93a tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1576 microversion: 2.1 time: 0.156776 May 17 12:27:49.297607 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 593/1196] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:27:49 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:27:50.315689 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-7c84671d-bffa-4fba-8c64-c92ffaa0f362 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:50.316422 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-7c84671d-bffa-4fba-8c64-c92ffaa0f362 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:50.322718 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7c84671d-bffa-4fba-8c64-c92ffaa0f362 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:50.323166 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7c84671d-bffa-4fba-8c64-c92ffaa0f362 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:50.323924 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7c84671d-bffa-4fba-8c64-c92ffaa0f362 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:50.324395 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-7c84671d-bffa-4fba-8c64-c92ffaa0f362 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:50.466890 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-7c84671d-bffa-4fba-8c64-c92ffaa0f362 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:27:50.474261 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-7c84671d-bffa-4fba-8c64-c92ffaa0f362 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1576 microversion: 2.1 time: 0.162870 May 17 12:27:50.474824 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 604/1197] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:27:50 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:27:51.339160 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [req-63d4c3bb-e2c2-4f73-8ed0-37bc3015b8fd req-83cbc224-9edf-4424-b93a-a0b921a0986a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f408b84-5740-49bc-affc-1cb66c5cdf13", "name": "network-vif-deleted", "tag": "77b4a31e-bbca-4968-a9c7-13f075b15a4e"}]} {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 12:27:51.348140 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-63d4c3bb-e2c2-4f73-8ed0-37bc3015b8fd req-83cbc224-9edf-4424-b93a-a0b921a0986a service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:51.348625 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [req-63d4c3bb-e2c2-4f73-8ed0-37bc3015b8fd req-83cbc224-9edf-4424-b93a-a0b921a0986a service nova] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:51.359940 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.compute.server_external_events [req-63d4c3bb-e2c2-4f73-8ed0-37bc3015b8fd req-83cbc224-9edf-4424-b93a-a0b921a0986a service nova] Creating event network-vif-deleted:77b4a31e-bbca-4968-a9c7-13f075b15a4e for instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 on hv-cinder-83769 May 17 12:27:51.364704 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [req-63d4c3bb-e2c2-4f73-8ed0-37bc3015b8fd req-83cbc224-9edf-4424-b93a-a0b921a0986a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029319 May 17 12:27:51.365308 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 594/1198] 10.222.0.58 () {64 vars in 1317 bytes} [Tue May 17 12:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 12:27:51.491957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-99407e9e-f072-46e3-8708-4370259886b1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:51.492620 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-99407e9e-f072-46e3-8708-4370259886b1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:51.499553 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-99407e9e-f072-46e3-8708-4370259886b1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:51.499999 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-99407e9e-f072-46e3-8708-4370259886b1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:51.500802 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-99407e9e-f072-46e3-8708-4370259886b1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:51.501238 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-99407e9e-f072-46e3-8708-4370259886b1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:51.565722 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.policy [None req-99407e9e-f072-46e3-8708-4370259886b1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '934f4b8dae3b410ebc6b8c03f47b15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96b18ec30b804e1e9ac7467a441c919b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117114) authorize /opt/stack/nova/nova/policy.py:199}} May 17 12:27:51.573218 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-99407e9e-f072-46e3-8708-4370259886b1 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 200 len: 1225 microversion: 2.1 time: 0.085085 May 17 12:27:51.573778 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 605/1199] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:27:51 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 12:27:52.593907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e30d59b6-1f55-4559-b5a2-0f0fa54e9c1c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:52.594619 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-e30d59b6-1f55-4559-b5a2-0f0fa54e9c1c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 5f408b84-5740-49bc-affc-1cb66c5cdf13] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:52.607274 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e30d59b6-1f55-4559-b5a2-0f0fa54e9c1c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:52.607729 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e30d59b6-1f55-4559-b5a2-0f0fa54e9c1c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:52.608544 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e30d59b6-1f55-4559-b5a2-0f0fa54e9c1c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:52.608986 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-e30d59b6-1f55-4559-b5a2-0f0fa54e9c1c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:52.625325 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-e30d59b6-1f55-4559-b5a2-0f0fa54e9c1c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] HTTP exception thrown: Instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 could not be found. May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e30d59b6-1f55-4559-b5a2-0f0fa54e9c1c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Request method failure captured: May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 HTTP/1.1 May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig5LxZbInB7SOHn1-qE9LapGrzhANUH9aSftVQ0EZUjmG7OGwhm_hknpBFmTPtcZvGBzad04sPm_wqmKzTo__buJWhfrbfSMmfnT3MeO5AeG7nS2KrX1OA6anFF7G6lidOz3m8WeugV33Abu_eRl66gd1ygXK2Vhbhid0tqlzFzcsZ0g May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 96b18ec30b804e1e9ac7467a441c919b May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:27:52.626952 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96b18ec30b804e1e9ac7467a441c919b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_96b18ec30b804e1e9ac7467a441c919b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/96b18ec30b804e1e9ac7467a441c919b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96b18ec30b804e1e9ac7467a441c919b"}]}] May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 96b18ec30b804e1e9ac7467a441c919b May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-TestVolumeBootPattern-1872407863-project May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 934f4b8dae3b410ebc6b8c03f47b15a7 May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-TestVolumeBootPattern-1872407863-project May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 could not be found. May 17 12:27:52.628767 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '5f408b84-5740-49bc-affc-1cb66c5cdf13'} May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 could not be found. May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:27:52.629713 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 could not be found. May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 could not be found. May 17 12:27:52.631608 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:52.633127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-e30d59b6-1f55-4559-b5a2-0f0fa54e9c1c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Returning 404 to user: Instance 5f408b84-5740-49bc-affc-1cb66c5cdf13 could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:27:52.633127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-e30d59b6-1f55-4559-b5a2-0f0fa54e9c1c tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13" status: 404 len: 111 microversion: 2.1 time: 0.041263 May 17 12:27:52.633127 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 595/1200] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:27:52 2022] GET /compute/v2.1/servers/5f408b84-5740-49bc-affc-1cb66c5cdf13 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:27:53.124832 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2fc94f4a-d3b7-4288-b8de-a1404cfc834f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:53.125393 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.compute.api [None req-2fc94f4a-d3b7-4288-b8de-a1404cfc834f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117114) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:53.131315 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2fc94f4a-d3b7-4288-b8de-a1404cfc834f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:53.131762 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2fc94f4a-d3b7-4288-b8de-a1404cfc834f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:53.132559 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2fc94f4a-d3b7-4288-b8de-a1404cfc834f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:53.132994 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG oslo_concurrency.lockutils [None req-2fc94f4a-d3b7-4288-b8de-a1404cfc834f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:53.147204 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.wsgi [None req-2fc94f4a-d3b7-4288-b8de-a1404cfc834f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] HTTP exception thrown: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2fc94f4a-d3b7-4288-b8de-a1404cfc834f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Request method failure captured: May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: request: DELETE /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade HTTP/1.1 May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept: application/json May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Accept-Encoding: identity May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Connection: close May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Length: 0 May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Content-Type: application/json May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Host: 10.222.0.58 May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Openstack-System-Scope: None May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: User-Agent: python-urllib3/1.26.9 May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Auth-Token: gAAAAABig5LxZbInB7SOHn1-qE9LapGrzhANUH9aSftVQ0EZUjmG7OGwhm_hknpBFmTPtcZvGBzad04sPm_wqmKzTo__buJWhfrbfSMmfnT3MeO5AeG7nS2KrX1OA6anFF7G6lidOz3m8WeugV33Abu_eRl66gd1ygXK2Vhbhid0tqlzFzcsZ0g May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Id: None May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Domain-Name: None May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Identity-Status: Confirmed May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Is-Admin-Project: True May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Id: default May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Domain-Name: Default May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Id: 96b18ec30b804e1e9ac7467a441c919b May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Project-Name: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Role: member,reader May 17 12:27:53.148957 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Roles: member,reader May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96b18ec30b804e1e9ac7467a441c919b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_96b18ec30b804e1e9ac7467a441c919b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/96b18ec30b804e1e9ac7467a441c919b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96b18ec30b804e1e9ac7467a441c919b"}]}] May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Id: 96b18ec30b804e1e9ac7467a441c919b May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-Tenant-Name: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User: tempest-TestVolumeBootPattern-1872407863-project May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Id: default May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Domain-Name: Default May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Id: 934f4b8dae3b410ebc6b8c03f47b15a7 May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: X-User-Name: tempest-TestVolumeBootPattern-1872407863-project May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: method: > May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: exception: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:27:53.150624 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: action_args: {'id': '4114b620-de69-4409-8d15-45289549bade'} May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:27:53.151596 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:27:53.153916 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: ERROR nova.api.openstack.wsgi May 17 12:27:53.155724 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-2fc94f4a-d3b7-4288-b8de-a1404cfc834f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Returning 404 to user: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. {{(pid=117114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:27:53.155724 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-2fc94f4a-d3b7-4288-b8de-a1404cfc834f tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 404 len: 111 microversion: 2.1 time: 0.030454 May 17 12:27:53.155724 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 606/1201] 10.222.0.58 () {58 vars in 1238 bytes} [Tue May 17 12:27:53 2022] DELETE /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:27:53.160050 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5429b328-f5d3-410d-bcfd-1831d87f9e51 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '>' {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:53.160696 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.compute.api [None req-5429b328-f5d3-410d-bcfd-1831d87f9e51 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] [instance: 4114b620-de69-4409-8d15-45289549bade] Fetching instance by UUID {{(pid=117113) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 12:27:53.166994 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5429b328-f5d3-410d-bcfd-1831d87f9e51 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:53.167568 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5429b328-f5d3-410d-bcfd-1831d87f9e51 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:53.168410 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5429b328-f5d3-410d-bcfd-1831d87f9e51 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 12:27:53.168847 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG oslo_concurrency.lockutils [None req-5429b328-f5d3-410d-bcfd-1831d87f9e51 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Lock "09ab1f8a-4b58-4541-9d13-ce3277a151d2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 12:27:53.185637 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.wsgi [None req-5429b328-f5d3-410d-bcfd-1831d87f9e51 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] HTTP exception thrown: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5429b328-f5d3-410d-bcfd-1831d87f9e51 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Request method failure captured: May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: request: GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade HTTP/1.1 May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept: application/json May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Accept-Encoding: identity May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Connection: close May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Length: 0 May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Content-Type: application/json May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Host: 10.222.0.58 May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Openstack-System-Scope: None May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: User-Agent: python-urllib3/1.26.9 May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Auth-Token: gAAAAABig5LxZbInB7SOHn1-qE9LapGrzhANUH9aSftVQ0EZUjmG7OGwhm_hknpBFmTPtcZvGBzad04sPm_wqmKzTo__buJWhfrbfSMmfnT3MeO5AeG7nS2KrX1OA6anFF7G6lidOz3m8WeugV33Abu_eRl66gd1ygXK2Vhbhid0tqlzFzcsZ0g May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Id: None May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Domain-Name: None May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Identity-Status: Confirmed May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Is-Admin-Project: True May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Id: default May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Domain-Name: Default May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Id: 96b18ec30b804e1e9ac7467a441c919b May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Project-Name: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Role: member,reader May 17 12:27:53.187156 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Roles: member,reader May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96b18ec30b804e1e9ac7467a441c919b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_96b18ec30b804e1e9ac7467a441c919b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/96b18ec30b804e1e9ac7467a441c919b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/96b18ec30b804e1e9ac7467a441c919b"}]}] May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Id: 96b18ec30b804e1e9ac7467a441c919b May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-Tenant-Name: tempest-TestVolumeBootPattern-1872407863 May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User: tempest-TestVolumeBootPattern-1872407863-project May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Id: default May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Domain-Name: Default May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Id: 934f4b8dae3b410ebc6b8c03f47b15a7 May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: X-User-Name: tempest-TestVolumeBootPattern-1872407863-project May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: method: > May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: exception: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:27:53.188785 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: action_args: {'id': '4114b620-de69-4409-8d15-45289549bade'} May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: {{(pid=117113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 12:27:53.189700 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. May 17 12:27:53.191189 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: ERROR nova.api.openstack.wsgi May 17 12:27:53.192864 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: DEBUG nova.api.openstack.wsgi [None req-5429b328-f5d3-410d-bcfd-1831d87f9e51 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Returning 404 to user: Instance 4114b620-de69-4409-8d15-45289549bade could not be found. {{(pid=117113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 12:27:53.192864 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO nova.api.openstack.requestlog [None req-5429b328-f5d3-410d-bcfd-1831d87f9e51 tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade" status: 404 len: 111 microversion: 2.1 time: 0.032428 May 17 12:27:53.193359 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: [pid: 117113|app: 0|req: 596/1202] 10.222.0.58 () {58 vars in 1235 bytes} [Tue May 17 12:27:53 2022] GET /compute/v2.1/servers/4114b620-de69-4409-8d15-45289549bade => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 12:27:54.488229 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: DEBUG nova.api.openstack.wsgi [None req-595f72b3-1875-49dd-82c2-759b4d5099ca tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] Calling method '.version_select at 0x7f2db433c0d0>' {{(pid=117114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 12:27:54.509713 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO nova.api.openstack.requestlog [None req-595f72b3-1875-49dd-82c2-759b4d5099ca tempest-TestVolumeBootPattern-1872407863 tempest-TestVolumeBootPattern-1872407863-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1078707457" status: 202 len: 0 microversion: 2.1 time: 0.025181 May 17 12:27:54.515293 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: [pid: 117114|app: 0|req: 607/1203] 10.222.0.58 () {58 vars in 1262 bytes} [Tue May 17 12:27:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1078707457 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 12:28:10.002333 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:28:10.002907 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Tue May 17 12:28:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:28:26.772442 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:28:26.773035 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Tue May 17 12:28:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:31:21.026095 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:31:21.026728 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Tue May 17 12:31:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:31:30.010609 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:31:30.011303 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Tue May 17 12:31:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:31:46.781381 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:31:46.781933 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Tue May 17 12:31:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:33:14.266551 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:33:14.267283 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Tue May 17 12:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:33:20.767934 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:33:20.768616 dv-cinder-837699-7-iscsi devstack@n-api.service[117114]: Tue May 17 12:33:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 12:33:37.710726 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 12:33:37.711276 dv-cinder-837699-7-iscsi devstack@n-api.service[117113]: Tue May 17 12:33:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!